![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17686 originally caused by: Started by upstream project "master-osmo-bsc" build number 20150 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20149 originally caused by: Started by upstream project "master-osmo-mgw" build number 9196 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30101 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37275 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37276 originally caused by: Started by upstream project "master-osmo-iuh" build number 12878 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12995 originally caused by: Started by upstream project "master-openbsc" build number 13193 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2994 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29315 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30101 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9260 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins13116963926714095301.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 03:34:38 + trial_dir_prefix=trial- + rm -rf trial-2398 trial-2398-bin.tgz trial-2398-run.tgz + trial_dir=trial-2399 + mkdir -p trial-2399 + mv open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2994.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2399 + cat open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2994.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2994.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2399 combinations: None trial: 'trial-2399' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2399 -------------------------------------------------------------------------------------------- 03:34:50.253710 tst trial-2399: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/log --------------------------------------------------------------------- trial-2399 nitb_sms:sysmo --------------------------------------------------------------------- 03:36:57.283547 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:36:57.287244 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 03:36:57.307708 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 03:36:57.314342 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 03:36:57.367262 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 03:36:57.388090 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 03:36:57.394894 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 03:36:57.933696 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:36:57.938682 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 03:36:57.949571 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 03:36:58.321996 tst mo_mt_sms.py: using LAC 38274 03:36:58.555773 tst mo_mt_sms.py: using RAC 24 03:36:58.669787 tst mo_mt_sms.py: using CellId 38274 03:36:58.793136 tst mo_mt_sms.py: using BVCI 38275 03:36:58.906198 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:36:59.087829 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 03:36:59.205572 tst mo_mt_sms.py:9: start nitb and bts... 03:36:59.405397 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:37:01.668015 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3449): Launched 03:37:02.034051 run osmo-nitb_10.42.42.2(pid=3450): Launched 03:37:02.234867 run osmo-nitb_10.42.42.2(pid=3450): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3450)] 03:37:02.361395 run osmo-nitb_10.42.42.2(pid=3450): stdout: | (launched: 2022-12-14_03:37:01.953515) 03:37:02.487601 run osmo-nitb_10.42.42.2(pid=3450): stderr: | (launched: 2022-12-14_03:37:02.017247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:02.612342 run osmo-nitb_10.42.42.2(pid=3450): stdout: | (launched: 2022-12-14_03:37:01.953515) 03:37:02.731070 run osmo-nitb_10.42.42.2(pid=3450): stderr: | (launched: 2022-12-14_03:37:02.017247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:02.873152 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3450): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3450) [trial-2399↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3450)] [trial-2399↪nitb_sms:sysmo↪mo_mt_sms.py:11] 03:37:02.881445 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 03:37:02.888034 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3449): Terminating (SIGTERM) 03:37:03.097640 --- ParallelTerminationStrategy: PID 3449 died... 03:37:03.118887 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3449): Terminated: ok {rc=0} 03:37:03.204377 bus /sierra_3: Setting Powered False 03:37:04.304087 bus /sierra_3: Setting Powered False 03:37:05.424521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:sysmo --------------------------------------------------------------------- 03:37:06.605260 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:06.609303 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 03:37:06.630298 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 03:37:06.657431 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 03:37:06.709630 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 03:37:06.730095 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 03:37:06.756547 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 03:37:07.303197 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:sysmo mo_mt_sms.py ---------------------------------------------- 03:37:07.308458 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.319161 tst sms:sysmo: Using 1 x bts (candidates: 1) 03:37:07.353136 tst mo_mt_sms.py: using LAC 38275 03:37:07.479198 tst mo_mt_sms.py: using RAC 25 03:37:07.603974 tst mo_mt_sms.py: using CellId 38275 03:37:07.723168 tst mo_mt_sms.py: using BVCI 38276 03:37:07.832463 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.843250 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.853967 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.864517 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.875456 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 03:37:07.886303 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:37:08.003243 tst sms:sysmo: Using 1 x modem (candidates: 2) 03:37:08.123413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:09.876795 run create_hlr_db(pid=3455): Launched 03:37:09.999365 bus /sierra_2: Setting Powered False 03:37:11.062549 run create_hlr_db(pid=3455): Terminated: ok {rc=0} 03:37:11.512516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Launched 03:37:11.834785 run osmo-hlr_10.42.42.2(pid=3458): Launched 03:37:11.957438 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:14.542394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Launched 03:37:14.864549 run osmo-stp_10.42.42.5(pid=3461): Launched 03:37:14.986051 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:20.348255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3463): Launched 03:37:20.669391 run osmo-msc_10.42.42.6(pid=3464): Launched 03:37:20.847083 run osmo-stp_10.42.42.5(pid=3461): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] 03:37:20.982384 run osmo-stp_10.42.42.5(pid=3461): stdout: | (launched: 2022-12-14_03:37:14.803983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:21.117893 run osmo-stp_10.42.42.5(pid=3461): stderr: | [0;m[38;5;43m20221214033714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033714998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033714998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033714999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033714999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:21.253869 run osmo-stp_10.42.42.5(pid=3461): stdout: | (launched: 2022-12-14_03:37:14.803983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:21.381381 run osmo-stp_10.42.42.5(pid=3461): stderr: | [0;m[38;5;43m20221214033714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033714997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033714998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033714998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033714998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033714999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033714999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:21.533923 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3461): Process ended prematurely: osmo-stp_10.42.42.5(pid=3461) [trial-2399↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] [trial-2399↪sms:sysmo↪mo_mt_sms.py:16] 03:37:21.542862 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 03:37:21.570310 run osmo-hlr_10.42.42.2(pid=3458): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3458)] 03:37:21.621253 run osmo-hlr_10.42.42.2(pid=3458): stdout: | (launched: 2022-12-14_03:37:11.774097) 03:37:21.674143 run osmo-hlr_10.42.42.2(pid=3458): stderr: | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033711973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033711989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033711999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033711999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033711999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:21.747010 run osmo-msc_10.42.42.6(pid=3464): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3464)] 03:37:21.797487 run osmo-msc_10.42.42.6(pid=3464): stdout: | (launched: 2022-12-14_03:37:20.608522) 03:37:21.850166 run osmo-msc_10.42.42.6(pid=3464): stderr: | [0;m[38;5;43m20221214033720933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033720934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda0b569c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033720934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033720934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033720934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033720934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033720936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033720936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033720936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033720936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:21.903031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Terminating (SIGTERM) 03:37:21.944795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Terminating (SIGTERM) 03:37:21.987034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3463): Terminating (SIGTERM) 03:37:22.029405 --- ParallelTerminationStrategy: PID 3457 died... 03:37:22.049833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Terminated: ok {rc=0} 03:37:22.096611 --- ParallelTerminationStrategy: PID 3460 died... 03:37:22.116660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Terminated: ok {rc=0} 03:37:22.163533 --- ParallelTerminationStrategy: PID 3463 died... 03:37:22.183608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3463): Terminated: ok {rc=0} 03:37:22.278107 bus /sierra_3: Setting Powered False 03:37:23.386761 bus /sierra_3: Setting Powered False 03:37:24.504546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:sysmo --------------------------------------------------------------------- 03:37:25.726616 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:25.730577 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:25.751768 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 03:37:25.758830 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:25.793721 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:25.814986 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 03:37:25.821912 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:26.344500 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:26.349794 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 03:37:26.360812 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:26.395230 tst assert_extension.py: using LAC 38276 03:37:26.515233 tst assert_extension.py: using RAC 26 03:37:26.634300 tst assert_extension.py: using CellId 38276 03:37:26.753031 tst assert_extension.py: using BVCI 38277 03:37:26.860353 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:26.980395 tst assert_extension.py:10: start nitb and bts... 03:37:27.179184 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:37:27.897799 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3470): Launched 03:37:28.222491 run osmo-nitb_10.42.42.2(pid=3471): Launched 03:37:28.399606 run osmo-nitb_10.42.42.2(pid=3471): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3471)] 03:37:28.543595 run osmo-nitb_10.42.42.2(pid=3471): stdout: | (launched: 2022-12-14_03:37:28.161800) 03:37:28.689460 run osmo-nitb_10.42.42.2(pid=3471): stderr: | (launched: 2022-12-14_03:37:28.209606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:28.834890 run osmo-nitb_10.42.42.2(pid=3471): stdout: | (launched: 2022-12-14_03:37:28.161800) 03:37:28.974047 run osmo-nitb_10.42.42.2(pid=3471): stderr: | (launched: 2022-12-14_03:37:28.209606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3471) [trial-2399↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3471)] 03:37:29.343597 tst osmo-nitb_10.42.42.2(pid=3471): stdout: | (launched: 2022-12-14_03:37:28.161800) 03:37:29.473916 tst osmo-nitb_10.42.42.2(pid=3471): stderr: | (launched: 2022-12-14_03:37:28.209606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:37:29.627360 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3471) [trial-2399↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3471)] [trial-2399↪nitb_ussd:sysmo↪assert_extension.py:12] 03:37:29.636289 tst assert_extension.py:12: Test FAILED (3.3 sec) 03:37:29.643533 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3470): Terminating (SIGTERM) 03:37:29.856439 --- ParallelTerminationStrategy: PID 3470 died... 03:37:29.877725 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3470): Terminated: ok {rc=0} 03:37:29.961958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:sysmo --------------------------------------------------------------------- 03:37:31.176111 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:31.180000 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 03:37:31.206145 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 03:37:31.243961 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 03:37:31.291167 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 03:37:31.319764 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 03:37:31.357192 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 03:37:31.899264 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:sysmo assert_extension.py ---------------------------------------------- 03:37:31.914080 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:31.925691 tst ussd:sysmo: Using 1 x bts (candidates: 1) 03:37:31.963470 tst assert_extension.py: using LAC 38277 03:37:32.119673 tst assert_extension.py: using RAC 27 03:37:32.263007 tst assert_extension.py: using CellId 38277 03:37:32.391925 tst assert_extension.py: using BVCI 38278 03:37:32.509842 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:32.520716 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:32.531607 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:32.542501 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:32.553636 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 03:37:32.564643 tst ussd:sysmo: Using 1 x modem (candidates: 1) 03:37:32.681556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:33.180293 run create_hlr_db(pid=3476): Launched 03:37:33.302772 bus /sierra_2: Setting Powered False 03:37:34.366109 run create_hlr_db(pid=3476): Terminated: ok {rc=0} 03:37:34.796300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3478): Launched 03:37:35.097659 run osmo-hlr_10.42.42.2(pid=3479): Launched 03:37:35.210351 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:35.728902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3481): Launched 03:37:36.030338 run osmo-stp_10.42.42.5(pid=3482): Launched 03:37:36.142856 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:36.682599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3484): Launched 03:37:36.982320 run osmo-msc_10.42.42.6(pid=3485): Launched 03:37:37.148545 run osmo-stp_10.42.42.5(pid=3482): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3482)] 03:37:37.274461 run osmo-stp_10.42.42.5(pid=3482): stdout: | (launched: 2022-12-14_03:37:35.972219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:37.402905 run osmo-stp_10.42.42.5(pid=3482): stderr: | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033736146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:37.528310 run osmo-stp_10.42.42.5(pid=3482): stdout: | (launched: 2022-12-14_03:37:35.972219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:37.646687 run osmo-stp_10.42.42.5(pid=3482): stderr: | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033736146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033736146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033736149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:37.788399 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3482): Process ended prematurely: osmo-stp_10.42.42.5(pid=3482) [trial-2399↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3482)] [trial-2399↪ussd:sysmo↪assert_extension.py:17] 03:37:37.796754 tst assert_extension.py:17: Test FAILED (5.9 sec) 03:37:37.822791 run osmo-hlr_10.42.42.2(pid=3479): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3479)] 03:37:37.870854 run osmo-hlr_10.42.42.2(pid=3479): stdout: | (launched: 2022-12-14_03:37:35.040536) 03:37:37.920511 run osmo-hlr_10.42.42.2(pid=3479): stderr: | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033735220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033735318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033735328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033735328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033735328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:37.989632 run osmo-msc_10.42.42.6(pid=3485): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3485)] 03:37:38.037731 run osmo-msc_10.42.42.6(pid=3485): stdout: | (launched: 2022-12-14_03:37:36.925147) 03:37:38.087362 run osmo-msc_10.42.42.6(pid=3485): stderr: | [0;m[38;5;43m20221214033737201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033737201 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e1a74ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033737201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033737201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033737201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033737202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033737203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033737204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033737204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033737204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:38.137471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3478): Terminating (SIGTERM) 03:37:38.177361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3481): Terminating (SIGTERM) 03:37:38.217315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3484): Terminating (SIGTERM) 03:37:38.257860 --- ParallelTerminationStrategy: PID 3478 died... 03:37:38.276816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3478): Terminated: ok {rc=0} 03:37:38.320748 --- ParallelTerminationStrategy: PID 3481 died... 03:37:38.339348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3481): Terminated: ok {rc=0} 03:37:38.383345 --- ParallelTerminationStrategy: PID 3484 died... 03:37:38.401935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3484): Terminated: ok {rc=0} 03:37:38.487907 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:37:39.689568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:37:39.698074 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:37:39.719372 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:37:39.750213 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:37:39.800787 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:37:39.821895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:37:39.848770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:37:40.402650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:37:40.458497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:40.469971 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:37:40.527362 tst mo_mt_call.py: using LAC 38278 03:37:40.648710 tst mo_mt_call.py: using RAC 28 03:37:40.769304 tst mo_mt_call.py: using CellId 38278 03:37:40.891704 tst mo_mt_call.py: using BVCI 38279 03:37:41.013026 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:41.024736 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:41.036172 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:41.047649 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:41.059362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:41.071170 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:41.188295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:41.307629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:41.817122 run create_hlr_db(pid=3490): Launched 03:37:41.942095 bus /sierra_2: Setting Powered False 03:37:43.006488 run create_hlr_db(pid=3490): Terminated: ok {rc=0} 03:37:43.445616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3492): Launched 03:37:43.753617 run osmo-hlr_10.42.42.2(pid=3493): Launched 03:37:43.869884 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:44.397278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3495): Launched 03:37:44.703192 run osmo-stp_10.42.42.5(pid=3496): Launched 03:37:44.818737 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:45.371633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3498): Launched 03:37:45.677907 run osmo-msc_10.42.42.6(pid=3499): Launched 03:37:45.866611 run osmo-stp_10.42.42.5(pid=3496): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3496)] 03:37:46.080443 run osmo-stp_10.42.42.5(pid=3496): stdout: | (launched: 2022-12-14_03:37:44.644839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:46.370944 run osmo-stp_10.42.42.5(pid=3496): stderr: | [0;m[38;5;43m20221214033744816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033744817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033744817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033744817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033744819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033744820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033744820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:46.536488 run osmo-stp_10.42.42.5(pid=3496): stdout: | (launched: 2022-12-14_03:37:44.644839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:46.672400 run osmo-stp_10.42.42.5(pid=3496): stderr: | [0;m[38;5;43m20221214033744816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033744817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033744817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033744817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033744819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033744820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033744820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:46.834573 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3496): Process ended prematurely: osmo-stp_10.42.42.5(pid=3496) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3496)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:37:46.845143 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:37:46.874434 run osmo-hlr_10.42.42.2(pid=3493): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3493)] 03:37:46.929587 run osmo-hlr_10.42.42.2(pid=3493): stdout: | (launched: 2022-12-14_03:37:43.695291) 03:37:46.984649 run osmo-hlr_10.42.42.2(pid=3493): stderr: | [0;m[1;31m20221214033743872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033743872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033743872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033743873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033743873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033743873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033743886 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033743894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033743895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033743895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:47.062406 run osmo-msc_10.42.42.6(pid=3499): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3499)] 03:37:47.117385 run osmo-msc_10.42.42.6(pid=3499): stdout: | (launched: 2022-12-14_03:37:45.619514) 03:37:47.172755 run osmo-msc_10.42.42.6(pid=3499): stderr: | [0;m[38;5;43m20221214033745962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033745962 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6cf917fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033745962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033745962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033745963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033745963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033745973 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033745973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033745973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033745973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:47.229409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3492): Terminating (SIGTERM) 03:37:47.274245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3495): Terminating (SIGTERM) 03:37:47.317618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3498): Terminating (SIGTERM) 03:37:47.361173 --- ParallelTerminationStrategy: PID 3492 died... 03:37:47.382091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3492): Terminated: ok {rc=0} 03:37:47.429703 --- ParallelTerminationStrategy: PID 3495 died... 03:37:47.450048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3495): Terminated: ok {rc=0} 03:37:47.497324 --- ParallelTerminationStrategy: PID 3498 died... 03:37:47.517740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3498): Terminated: ok {rc=0} 03:37:47.607576 bus /sierra_3: Setting Powered False 03:37:48.707013 bus /sierra_3: Setting Powered False 03:37:49.824369 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:37:50.975148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:50.987532 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:37:51.045820 tst mo_mt_call_osmux.py: using LAC 38279 03:37:51.175809 tst mo_mt_call_osmux.py: using RAC 29 03:37:51.306293 tst mo_mt_call_osmux.py: using CellId 38279 03:37:51.436592 tst mo_mt_call_osmux.py: using BVCI 38280 03:37:51.557294 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:51.568744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:51.580078 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:51.591353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:51.603222 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:37:51.614883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:51.732808 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:37:51.853746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:37:52.364584 run create_hlr_db(pid=3501): Launched 03:37:52.490487 bus /sierra_2: Setting Powered False 03:37:53.555025 run create_hlr_db(pid=3501): Terminated: ok {rc=0} 03:37:54.012887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3503): Launched 03:37:54.344012 run osmo-hlr_10.42.42.2(pid=3504): Launched 03:37:54.469985 run osmo-stp_10.42.42.5: Starting osmo-stp 03:37:55.035645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3506): Launched 03:37:55.364864 run osmo-stp_10.42.42.5(pid=3507): Launched 03:37:55.490524 run osmo-msc_10.42.42.6: Starting osmo-msc 03:37:56.083208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3509): Launched 03:37:56.412775 run osmo-msc_10.42.42.6(pid=3510): Launched 03:37:56.595169 run osmo-stp_10.42.42.5(pid=3507): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3507)] 03:37:56.737889 run osmo-stp_10.42.42.5(pid=3507): stdout: | (launched: 2022-12-14_03:37:55.303425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:56.872360 run osmo-stp_10.42.42.5(pid=3507): stderr: | [0;m[38;5;43m20221214033755497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033755498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033755498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033755498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:57.008664 run osmo-stp_10.42.42.5(pid=3507): stdout: | (launched: 2022-12-14_03:37:55.303425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:37:57.138997 run osmo-stp_10.42.42.5(pid=3507): stderr: | [0;m[38;5;43m20221214033755497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033755498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033755498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033755498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033755499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:37:57.295349 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3507): Process ended prematurely: osmo-stp_10.42.42.5(pid=3507) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3507)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:37:57.305148 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:37:57.333044 run osmo-hlr_10.42.42.2(pid=3504): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3504)] 03:37:57.384176 run osmo-hlr_10.42.42.2(pid=3504): stdout: | (launched: 2022-12-14_03:37:54.282115) 03:37:57.436562 run osmo-hlr_10.42.42.2(pid=3504): stderr: | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033754482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033754500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033754509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033754509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033754509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:37:57.509532 run osmo-msc_10.42.42.6(pid=3510): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3510)] 03:37:57.560022 run osmo-msc_10.42.42.6(pid=3510): stdout: | (launched: 2022-12-14_03:37:56.351224) 03:37:57.612906 run osmo-msc_10.42.42.6(pid=3510): stderr: | [0;m[38;5;43m20221214033756675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033756675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f308aa46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033756675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033756675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033756675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033756675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033756677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033756678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033756678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033756678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:37:57.665756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3503): Terminating (SIGTERM) 03:37:57.707514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3506): Terminating (SIGTERM) 03:37:57.749806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3509): Terminating (SIGTERM) 03:37:57.792182 --- ParallelTerminationStrategy: PID 3503 died... 03:37:57.812535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3503): Terminated: ok {rc=0} 03:37:57.859120 --- ParallelTerminationStrategy: PID 3506 died... 03:37:57.879084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3506): Terminated: ok {rc=0} 03:37:57.925534 --- ParallelTerminationStrategy: PID 3509 died... 03:37:57.945437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3509): Terminated: ok {rc=0} 03:37:58.034402 bus /sierra_3: Setting Powered False 03:37:59.132214 bus /sierra_3: Setting Powered False 03:38:00.250972 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:38:01.492189 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:01.502097 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:38:01.531319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:38:01.568018 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:38:01.633644 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:38:01.679995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:38:01.727821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:38:02.238684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:38:02.290406 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.301547 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:38:02.357208 tst mo_mt_call.py: using LAC 38280 03:38:02.480688 tst mo_mt_call.py: using RAC 30 03:38:02.604159 tst mo_mt_call.py: using CellId 38280 03:38:02.724592 tst mo_mt_call.py: using BVCI 38281 03:38:02.835596 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.846797 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.857794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.868380 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.879634 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:02.890975 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:03.011080 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:03.127882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:03.604204 run create_hlr_db(pid=3515): Launched 03:38:03.730874 bus /sierra_2: Setting Powered False 03:38:04.791674 run create_hlr_db(pid=3515): Terminated: ok {rc=0} 03:38:05.216524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Launched 03:38:05.523398 run osmo-hlr_10.42.42.2(pid=3518): Launched 03:38:05.638824 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:06.181521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Launched 03:38:06.511508 run osmo-stp_10.42.42.5(pid=3521): Launched 03:38:06.636516 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:07.229608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3523): Launched 03:38:07.558451 run osmo-msc_10.42.42.6(pid=3524): Launched 03:38:07.741156 run osmo-stp_10.42.42.5(pid=3521): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] 03:38:07.879600 run osmo-stp_10.42.42.5(pid=3521): stdout: | (launched: 2022-12-14_03:38:06.449808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:08.018633 run osmo-stp_10.42.42.5(pid=3521): stderr: | [0;m[38;5;43m20221214033806646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033806647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033806647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033806647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:08.157324 run osmo-stp_10.42.42.5(pid=3521): stdout: | (launched: 2022-12-14_03:38:06.449808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:08.287526 run osmo-stp_10.42.42.5(pid=3521): stderr: | [0;m[38;5;43m20221214033806646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033806647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033806647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033806647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033806648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:08.443679 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3521): Process ended prematurely: osmo-stp_10.42.42.5(pid=3521) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:38:08.453508 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:38:08.481247 run osmo-hlr_10.42.42.2(pid=3518): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3518)] 03:38:08.532263 run osmo-hlr_10.42.42.2(pid=3518): stdout: | (launched: 2022-12-14_03:38:05.464780) 03:38:08.584200 run osmo-hlr_10.42.42.2(pid=3518): stderr: | [0;m[1;31m20221214033805643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033805643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033805643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033805644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033805644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033805644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033805656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033805667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033805668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033805668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:08.656248 run osmo-msc_10.42.42.6(pid=3524): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3524)] 03:38:08.706003 run osmo-msc_10.42.42.6(pid=3524): stdout: | (launched: 2022-12-14_03:38:07.496376) 03:38:08.757998 run osmo-msc_10.42.42.6(pid=3524): stderr: | [0;m[38;5;43m20221214033807820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033807821 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30c83d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033807821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033807821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033807821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033807821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033807823 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033807823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033807823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033807823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:08.810653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Terminating (SIGTERM) 03:38:08.852821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Terminating (SIGTERM) 03:38:08.894874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3523): Terminating (SIGTERM) 03:38:08.936698 --- ParallelTerminationStrategy: PID 3517 died... 03:38:08.957298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3517): Terminated: ok {rc=0} 03:38:09.003434 --- ParallelTerminationStrategy: PID 3520 died... 03:38:09.023264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3520): Terminated: ok {rc=0} 03:38:09.069866 --- ParallelTerminationStrategy: PID 3523 died... 03:38:09.089920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3523): Terminated: ok {rc=0} 03:38:09.178226 bus /sierra_3: Setting Powered False 03:38:10.278228 bus /sierra_3: Setting Powered False 03:38:11.393910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:38:12.543932 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:12.556271 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:38:12.618953 tst mo_mt_call_osmux.py: using LAC 38281 03:38:12.746897 tst mo_mt_call_osmux.py: using RAC 31 03:38:12.874966 tst mo_mt_call_osmux.py: using CellId 38281 03:38:13.001373 tst mo_mt_call_osmux.py: using BVCI 38282 03:38:13.120383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:13.132024 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:13.143469 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:13.154839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:13.166891 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:38:13.178683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:13.299487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:38:13.416729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:13.894388 run create_hlr_db(pid=3526): Launched 03:38:14.020607 bus /sierra_2: Setting Powered False 03:38:15.081080 run create_hlr_db(pid=3526): Terminated: ok {rc=0} 03:38:15.530233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3528): Launched 03:38:15.869816 run osmo-hlr_10.42.42.2(pid=3529): Launched 03:38:16.114518 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:16.838156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3531): Launched 03:38:17.167004 run osmo-stp_10.42.42.5(pid=3532): Launched 03:38:17.468809 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:18.061982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3534): Launched 03:38:18.392508 run osmo-msc_10.42.42.6(pid=3535): Launched 03:38:18.575196 run osmo-stp_10.42.42.5(pid=3532): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3532)] 03:38:18.713795 run osmo-stp_10.42.42.5(pid=3532): stdout: | (launched: 2022-12-14_03:38:17.105071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:18.852358 run osmo-stp_10.42.42.5(pid=3532): stderr: | [0;m[38;5;43m20221214033817327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033817327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033817328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033817328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033817330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033817330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033817331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:18.989966 run osmo-stp_10.42.42.5(pid=3532): stdout: | (launched: 2022-12-14_03:38:17.105071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:19.120395 run osmo-stp_10.42.42.5(pid=3532): stderr: | [0;m[38;5;43m20221214033817327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033817327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033817328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033817328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033817330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033817330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033817331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:19.276834 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3532): Process ended prematurely: osmo-stp_10.42.42.5(pid=3532) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3532)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:38:19.286483 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 03:38:19.314417 run osmo-hlr_10.42.42.2(pid=3529): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3529)] 03:38:19.365096 run osmo-hlr_10.42.42.2(pid=3529): stdout: | (launched: 2022-12-14_03:38:15.798267) 03:38:19.417498 run osmo-hlr_10.42.42.2(pid=3529): stderr: | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033816092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033816119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033816138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033816141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033816141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:19.489830 run osmo-msc_10.42.42.6(pid=3535): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3535)] 03:38:19.539667 run osmo-msc_10.42.42.6(pid=3535): stdout: | (launched: 2022-12-14_03:38:18.330609) 03:38:19.592226 run osmo-msc_10.42.42.6(pid=3535): stderr: | [0;m[38;5;43m20221214033818655 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033818655 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6557d51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033818655 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033818656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033818656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033818656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033818658 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033818659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033818659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033818659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:19.644645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3528): Terminating (SIGTERM) 03:38:19.686262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3531): Terminating (SIGTERM) 03:38:19.728505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3534): Terminating (SIGTERM) 03:38:19.770994 --- ParallelTerminationStrategy: PID 3528 died... 03:38:19.791302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3528): Terminated: ok {rc=0} 03:38:19.837561 --- ParallelTerminationStrategy: PID 3531 died... 03:38:19.857367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3531): Terminated: ok {rc=0} 03:38:19.903413 --- ParallelTerminationStrategy: PID 3534 died... 03:38:19.923289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3534): Terminated: ok {rc=0} 03:38:20.011456 bus /sierra_3: Setting Powered False 03:38:21.110461 bus /sierra_3: Setting Powered False 03:38:22.226345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:38:23.462007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:23.469591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:38:23.490155 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:38:23.516669 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:38:23.568100 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:38:23.588758 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:38:23.614941 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:38:24.166813 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:38:24.221518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.233032 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:24.291285 tst mo_mt_call.py: using LAC 38282 03:38:24.420715 tst mo_mt_call.py: using RAC 32 03:38:24.550258 tst mo_mt_call.py: using CellId 38282 03:38:24.680524 tst mo_mt_call.py: using BVCI 38283 03:38:24.799616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.811214 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.822468 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.833693 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.845261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:24.857327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:24.974424 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:25.095147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:25.606304 run create_hlr_db(pid=3543): Launched 03:38:25.733840 bus /sierra_2: Setting Powered False 03:38:26.797969 run create_hlr_db(pid=3543): Terminated: ok {rc=0} 03:38:27.235945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Launched 03:38:27.543535 run osmo-hlr_10.42.42.2(pid=3546): Launched 03:38:27.660359 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:28.206659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Launched 03:38:28.512518 run osmo-stp_10.42.42.5(pid=3549): Launched 03:38:28.629441 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:29.182777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Launched 03:38:29.489854 run osmo-msc_10.42.42.6(pid=3552): Launched 03:38:29.660182 run osmo-stp_10.42.42.5(pid=3549): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] 03:38:29.789485 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-14_03:38:28.454733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:29.917912 run osmo-stp_10.42.42.5(pid=3549): stderr: | [0;m[38;5;43m20221214033828627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033828627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033828628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033828628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:30.044568 run osmo-stp_10.42.42.5(pid=3549): stdout: | (launched: 2022-12-14_03:38:28.454733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:30.165191 run osmo-stp_10.42.42.5(pid=3549): stderr: | [0;m[38;5;43m20221214033828627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033828627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033828628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033828628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033828630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:30.309817 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:38:30.318667 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:38:30.345118 run osmo-hlr_10.42.42.2(pid=3546): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3546)] 03:38:30.393069 run osmo-hlr_10.42.42.2(pid=3546): stdout: | (launched: 2022-12-14_03:38:27.485323) 03:38:30.442555 run osmo-hlr_10.42.42.2(pid=3546): stderr: | [0;m[1;31m20221214033827666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033827666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033827666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033827666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033827666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033827667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033827679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033827689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033827689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033827689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:30.511853 run osmo-msc_10.42.42.6(pid=3552): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3552)] 03:38:30.559687 run osmo-msc_10.42.42.6(pid=3552): stdout: | (launched: 2022-12-14_03:38:29.431303) 03:38:30.609226 run osmo-msc_10.42.42.6(pid=3552): stderr: | [0;m[38;5;43m20221214033829704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033829704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f6a1a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033829704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033829704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033829705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033829705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033829706 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033829707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033829707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033829707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:30.658957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminating (SIGTERM) 03:38:30.698738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminating (SIGTERM) 03:38:30.738326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminating (SIGTERM) 03:38:30.778151 --- ParallelTerminationStrategy: PID 3545 died... 03:38:30.797226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3545): Terminated: ok {rc=0} 03:38:30.851927 --- ParallelTerminationStrategy: PID 3548 died... 03:38:30.873112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3548): Terminated: ok {rc=0} 03:38:30.942854 --- ParallelTerminationStrategy: PID 3551 died... 03:38:30.969495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3551): Terminated: ok {rc=0} 03:38:31.067137 bus /sierra_3: Setting Powered False 03:38:32.174112 bus /sierra_3: Setting Powered False 03:38:33.293602 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:38:34.443583 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:34.455692 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:38:34.514234 tst mo_mt_call_osmux.py: using LAC 38283 03:38:34.644175 tst mo_mt_call_osmux.py: using RAC 33 03:38:34.773950 tst mo_mt_call_osmux.py: using CellId 38283 03:38:34.904498 tst mo_mt_call_osmux.py: using BVCI 38284 03:38:35.025526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:35.037140 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:35.048382 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:35.059729 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:35.071297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:38:35.083019 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:35.199741 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:38:35.320527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:35.831099 run create_hlr_db(pid=3554): Launched 03:38:35.958977 bus /sierra_2: Setting Powered False 03:38:37.022908 run create_hlr_db(pid=3554): Terminated: ok {rc=0} 03:38:37.460317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Launched 03:38:37.767259 run osmo-hlr_10.42.42.2(pid=3557): Launched 03:38:37.883850 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:38.411248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Launched 03:38:38.717337 run osmo-stp_10.42.42.5(pid=3560): Launched 03:38:38.833476 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:39.404416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Launched 03:38:39.712802 run osmo-msc_10.42.42.6(pid=3563): Launched 03:38:39.884650 run osmo-stp_10.42.42.5(pid=3560): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] 03:38:40.013836 run osmo-stp_10.42.42.5(pid=3560): stdout: | (launched: 2022-12-14_03:38:38.659296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:40.143086 run osmo-stp_10.42.42.5(pid=3560): stderr: | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033838833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:40.270438 run osmo-stp_10.42.42.5(pid=3560): stdout: | (launched: 2022-12-14_03:38:38.659296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:40.391540 run osmo-stp_10.42.42.5(pid=3560): stderr: | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033838832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033838833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033838835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:40.536321 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3560): Process ended prematurely: osmo-stp_10.42.42.5(pid=3560) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:38:40.545414 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:38:40.571844 run osmo-hlr_10.42.42.2(pid=3557): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3557)] 03:38:40.619519 run osmo-hlr_10.42.42.2(pid=3557): stdout: | (launched: 2022-12-14_03:38:37.708852) 03:38:40.669062 run osmo-hlr_10.42.42.2(pid=3557): stderr: | [0;m[1;31m20221214033837886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033837887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033837887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033837887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033837887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033837887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033837899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033837907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033837908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033837908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:40.737759 run osmo-msc_10.42.42.6(pid=3563): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3563)] 03:38:40.785832 run osmo-msc_10.42.42.6(pid=3563): stdout: | (launched: 2022-12-14_03:38:39.654274) 03:38:40.835244 run osmo-msc_10.42.42.6(pid=3563): stderr: | [0;m[38;5;43m20221214033839928 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033839928 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcd51b75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033839928 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033839928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033839929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033839929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033839930 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033839931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033839931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033839931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:40.884703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Terminating (SIGTERM) 03:38:40.924440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Terminating (SIGTERM) 03:38:40.964161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Terminating (SIGTERM) 03:38:41.004001 --- ParallelTerminationStrategy: PID 3556 died... 03:38:41.023410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3556): Terminated: ok {rc=0} 03:38:41.067311 --- ParallelTerminationStrategy: PID 3559 died... 03:38:41.086044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3559): Terminated: ok {rc=0} 03:38:41.129758 --- ParallelTerminationStrategy: PID 3562 died... 03:38:41.148262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3562): Terminated: ok {rc=0} 03:38:41.232165 bus /sierra_3: Setting Powered False 03:38:42.330530 bus /sierra_3: Setting Powered False 03:38:43.447932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:38:44.686310 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:38:44.692647 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:38:44.713299 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:38:44.739900 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:38:44.790715 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:38:44.811284 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:38:44.837490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:38:45.387706 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:38:45.436270 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:45.447404 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:38:45.507781 tst mo_mt_call.py: using LAC 38284 03:38:45.626457 tst mo_mt_call.py: using RAC 34 03:38:45.745930 tst mo_mt_call.py: using CellId 38284 03:38:45.871179 tst mo_mt_call.py: using BVCI 38285 03:38:45.992019 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:46.004101 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:46.015987 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:46.027978 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:46.040058 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:46.052274 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:46.190459 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:46.327305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:46.824187 run create_hlr_db(pid=3568): Launched 03:38:46.982038 bus /sierra_2: Setting Powered False 03:38:48.041642 run create_hlr_db(pid=3568): Terminated: ok {rc=0} 03:38:48.468257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Launched 03:38:48.774265 run osmo-hlr_10.42.42.2(pid=3571): Launched 03:38:48.889910 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:49.422857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Launched 03:38:49.729900 run osmo-stp_10.42.42.5(pid=3574): Launched 03:38:49.847980 run osmo-msc_10.42.42.6: Starting osmo-msc 03:38:50.401951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Launched 03:38:50.708625 run osmo-msc_10.42.42.6(pid=3577): Launched 03:38:50.878711 run osmo-stp_10.42.42.5(pid=3574): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] 03:38:51.007251 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-14_03:38:49.671497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:51.136183 run osmo-stp_10.42.42.5(pid=3574): stderr: | [0;m[38;5;43m20221214033849844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033849845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033849845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033849846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:51.263101 run osmo-stp_10.42.42.5(pid=3574): stdout: | (launched: 2022-12-14_03:38:49.671497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:38:51.383717 run osmo-stp_10.42.42.5(pid=3574): stderr: | [0;m[38;5;43m20221214033849844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033849845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033849845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033849846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033849847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:38:51.527903 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:38:51.536891 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:38:51.563381 run osmo-hlr_10.42.42.2(pid=3571): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3571)] 03:38:51.611392 run osmo-hlr_10.42.42.2(pid=3571): stdout: | (launched: 2022-12-14_03:38:48.716176) 03:38:51.660711 run osmo-hlr_10.42.42.2(pid=3571): stderr: | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033848896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033848909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033848919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033848919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033848919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:38:51.729507 run osmo-msc_10.42.42.6(pid=3577): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3577)] 03:38:51.777228 run osmo-msc_10.42.42.6(pid=3577): stdout: | (launched: 2022-12-14_03:38:50.650719) 03:38:51.826553 run osmo-msc_10.42.42.6(pid=3577): stderr: | [0;m[38;5;43m20221214033850925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033850925 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91d29a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033850925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033850926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033850926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033850926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033850928 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033850928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033850928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033850928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:38:51.876173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminating (SIGTERM) 03:38:51.916330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminating (SIGTERM) 03:38:51.955895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminating (SIGTERM) 03:38:51.995646 --- ParallelTerminationStrategy: PID 3570 died... 03:38:52.014720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3570): Terminated: ok {rc=0} 03:38:52.058768 --- ParallelTerminationStrategy: PID 3573 died... 03:38:52.077418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3573): Terminated: ok {rc=0} 03:38:52.121219 --- ParallelTerminationStrategy: PID 3576 died... 03:38:52.139892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3576): Terminated: ok {rc=0} 03:38:52.223269 bus /sierra_3: Setting Powered False 03:38:53.322177 bus /sierra_3: Setting Powered False 03:38:54.438925 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:38:55.589400 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:55.601776 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:38:55.658136 tst mo_mt_call_osmux.py: using LAC 38285 03:38:55.785141 tst mo_mt_call_osmux.py: using RAC 35 03:38:55.911431 tst mo_mt_call_osmux.py: using CellId 38285 03:38:56.038293 tst mo_mt_call_osmux.py: using BVCI 38286 03:38:56.157857 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:56.169346 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:56.180459 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:56.192062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:56.203724 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:38:56.215367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:56.332276 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:38:56.453953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:38:56.966072 run create_hlr_db(pid=3579): Launched 03:38:57.091865 bus /sierra_2: Setting Powered False 03:38:58.156277 run create_hlr_db(pid=3579): Terminated: ok {rc=0} 03:38:58.596117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Launched 03:38:58.903623 run osmo-hlr_10.42.42.2(pid=3582): Launched 03:38:59.020176 run osmo-stp_10.42.42.5: Starting osmo-stp 03:38:59.549592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Launched 03:38:59.857282 run osmo-stp_10.42.42.5(pid=3585): Launched 03:38:59.975073 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:00.531110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Launched 03:39:00.838825 run osmo-msc_10.42.42.6(pid=3588): Launched 03:39:01.117467 run osmo-stp_10.42.42.5(pid=3585): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] 03:39:01.469720 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-14_03:38:59.798812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:01.847741 run osmo-stp_10.42.42.5(pid=3585): stderr: | [0;m[38;5;43m20221214033859970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033859971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033859971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033859971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:02.028187 run osmo-stp_10.42.42.5(pid=3585): stdout: | (launched: 2022-12-14_03:38:59.798812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:02.204059 run osmo-stp_10.42.42.5(pid=3585): stderr: | [0;m[38;5;43m20221214033859970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033859971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033859971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033859971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033859972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:02.386002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:39:02.399589 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 03:39:02.431441 run osmo-hlr_10.42.42.2(pid=3582): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3582)] 03:39:02.498383 run osmo-hlr_10.42.42.2(pid=3582): stdout: | (launched: 2022-12-14_03:38:58.845538) 03:39:02.561241 run osmo-hlr_10.42.42.2(pid=3582): stderr: | [0;m[1;31m20221214033859020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033859020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033859020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033859020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033859020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033859021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033859032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033859041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033859041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033859041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:02.647602 run osmo-msc_10.42.42.6(pid=3588): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3588)] 03:39:02.710535 run osmo-msc_10.42.42.6(pid=3588): stdout: | (launched: 2022-12-14_03:39:00.779315) 03:39:02.770134 run osmo-msc_10.42.42.6(pid=3588): stderr: | [0;m[38;5;43m20221214033901496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033901496 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ef8af4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033901496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033901496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033901497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033901497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033901501 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033901502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033901502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033901502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:02.833797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminating (SIGTERM) 03:39:02.892802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminating (SIGTERM) 03:39:02.947887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Terminating (SIGTERM) 03:39:02.995070 --- ParallelTerminationStrategy: PID 3581 died... 03:39:03.021215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3581): Terminated: ok {rc=0} 03:39:03.081697 --- ParallelTerminationStrategy: PID 3584 died... 03:39:03.106847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3584): Terminated: ok {rc=0} 03:39:03.171433 --- ParallelTerminationStrategy: PID 3587 died... 03:39:03.199325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3587): Terminated: ok {rc=0} 03:39:03.312324 bus /sierra_3: Setting Powered False 03:39:04.437940 bus /sierra_3: Setting Powered False 03:39:05.559097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:39:06.798463 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:06.805628 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:39:06.827887 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:39:06.857349 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:39:06.908530 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:39:06.930747 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:39:06.960058 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:39:07.509997 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:39:07.566940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:07.579702 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:39:07.640830 tst mo_mt_call.py: using LAC 38286 03:39:07.776415 tst mo_mt_call.py: using RAC 36 03:39:07.920633 tst mo_mt_call.py: using CellId 38286 03:39:08.052780 tst mo_mt_call.py: using BVCI 38287 03:39:08.177148 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:08.189977 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:08.202490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:08.214980 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:08.228458 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:08.242152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:08.370645 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:08.495449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:09.019597 run create_hlr_db(pid=3865): Launched 03:39:09.189692 bus /sierra_2: Setting Powered False 03:39:10.258665 run create_hlr_db(pid=3865): Terminated: ok {rc=0} 03:39:10.736376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Launched 03:39:11.089920 run osmo-hlr_10.42.42.2(pid=3868): Launched 03:39:11.351236 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:12.035401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Launched 03:39:12.391269 run osmo-stp_10.42.42.5(pid=3871): Launched 03:39:12.644852 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:13.337536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Launched 03:39:13.689179 run osmo-msc_10.42.42.6(pid=3874): Launched 03:39:14.063896 run osmo-stp_10.42.42.5(pid=3871): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] 03:39:14.347877 run osmo-stp_10.42.42.5(pid=3871): stdout: | (launched: 2022-12-14_03:39:12.326136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:14.528455 run osmo-stp_10.42.42.5(pid=3871): stderr: | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033912634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:14.671083 run osmo-stp_10.42.42.5(pid=3871): stdout: | (launched: 2022-12-14_03:39:12.326136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:14.806066 run osmo-stp_10.42.42.5(pid=3871): stderr: | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033912633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033912634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033912634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:14.967949 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3871): Process ended prematurely: osmo-stp_10.42.42.5(pid=3871) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:39:14.979127 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 03:39:15.008453 run osmo-hlr_10.42.42.2(pid=3868): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3868)] 03:39:15.065361 run osmo-hlr_10.42.42.2(pid=3868): stdout: | (launched: 2022-12-14_03:39:11.024432) 03:39:15.121938 run osmo-hlr_10.42.42.2(pid=3868): stderr: | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033911347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033911363 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033911373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033911373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033911373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:15.198669 run osmo-msc_10.42.42.6(pid=3874): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3874)] 03:39:15.254162 run osmo-msc_10.42.42.6(pid=3874): stdout: | (launched: 2022-12-14_03:39:13.623776) 03:39:15.309658 run osmo-msc_10.42.42.6(pid=3874): stderr: | [0;m[38;5;43m20221214033914135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033914135 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbae8470c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033914135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033914135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033914135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033914135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033914145 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033914146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033914146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033914146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:15.366683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Terminating (SIGTERM) 03:39:15.413170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Terminating (SIGTERM) 03:39:15.461422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Terminating (SIGTERM) 03:39:15.509246 --- ParallelTerminationStrategy: PID 3867 died... 03:39:15.531965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3867): Terminated: ok {rc=0} 03:39:15.584268 --- ParallelTerminationStrategy: PID 3870 died... 03:39:15.605336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3870): Terminated: ok {rc=0} 03:39:15.655539 --- ParallelTerminationStrategy: PID 3873 died... 03:39:15.678059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3873): Terminated: ok {rc=0} 03:39:15.772618 bus /sierra_3: Setting Powered False 03:39:16.900137 bus /sierra_3: Setting Powered False 03:39:18.061494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:39:19.220384 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.233792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:39:19.296009 tst mo_mt_call_osmux.py: using LAC 38287 03:39:19.428811 tst mo_mt_call_osmux.py: using RAC 37 03:39:19.566252 tst mo_mt_call_osmux.py: using CellId 38287 03:39:19.699927 tst mo_mt_call_osmux.py: using BVCI 38288 03:39:19.824482 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.837053 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.850795 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.863407 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.876780 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:39:19.890040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:20.017926 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:39:20.150180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:20.685825 run create_hlr_db(pid=3876): Launched 03:39:20.856240 bus /sierra_2: Setting Powered False 03:39:21.922328 run create_hlr_db(pid=3876): Terminated: ok {rc=0} 03:39:22.398037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Launched 03:39:22.754383 run osmo-hlr_10.42.42.2(pid=3879): Launched 03:39:23.010486 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:23.694709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Launched 03:39:24.043145 run osmo-stp_10.42.42.5(pid=3882): Launched 03:39:24.169491 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:24.764228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Launched 03:39:25.093554 run osmo-msc_10.42.42.6(pid=3885): Launched 03:39:25.276577 run osmo-stp_10.42.42.5(pid=3882): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] 03:39:25.415342 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-14_03:39:23.981680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:25.554490 run osmo-stp_10.42.42.5(pid=3882): stderr: | [0;m[38;5;43m20221214033924175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033924176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033924176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033924176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:25.693306 run osmo-stp_10.42.42.5(pid=3882): stdout: | (launched: 2022-12-14_03:39:23.981680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:25.823492 run osmo-stp_10.42.42.5(pid=3882): stderr: | [0;m[38;5;43m20221214033924175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033924176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033924176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033924176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033924177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:25.979783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:39:25.989410 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 03:39:26.017131 run osmo-hlr_10.42.42.2(pid=3879): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3879)] 03:39:26.067868 run osmo-hlr_10.42.42.2(pid=3879): stdout: | (launched: 2022-12-14_03:39:22.689934) 03:39:26.120449 run osmo-hlr_10.42.42.2(pid=3879): stderr: | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033923003 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033923019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033923036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033923036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033923036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:26.193221 run osmo-msc_10.42.42.6(pid=3885): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3885)] 03:39:26.243252 run osmo-msc_10.42.42.6(pid=3885): stdout: | (launched: 2022-12-14_03:39:25.031495) 03:39:26.295198 run osmo-msc_10.42.42.6(pid=3885): stderr: | [0;m[38;5;43m20221214033925356 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033925357 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f359e2a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033925357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033925357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033925357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033925357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033925359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033925359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033925359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033925359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:26.347917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminating (SIGTERM) 03:39:26.390148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminating (SIGTERM) 03:39:26.431959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Terminating (SIGTERM) 03:39:26.474124 --- ParallelTerminationStrategy: PID 3878 died... 03:39:26.494417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3878): Terminated: ok {rc=0} 03:39:26.540713 --- ParallelTerminationStrategy: PID 3881 died... 03:39:26.560613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3881): Terminated: ok {rc=0} 03:39:26.606871 --- ParallelTerminationStrategy: PID 3884 died... 03:39:26.626734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3884): Terminated: ok {rc=0} 03:39:26.714586 bus /sierra_3: Setting Powered False 03:39:27.812905 bus /sierra_3: Setting Powered False 03:39:28.926972 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:39:30.164553 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:30.171688 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:39:30.193111 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:39:30.221675 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:39:30.278323 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:39:30.300453 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:39:30.327916 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:39:30.875138 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:39:30.938522 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:30.951367 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:31.015466 tst mo_mt_call.py: using LAC 38288 03:39:31.151489 tst mo_mt_call.py: using RAC 38 03:39:31.306549 tst mo_mt_call.py: using CellId 38288 03:39:31.426952 tst mo_mt_call.py: using BVCI 38289 03:39:31.543491 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:31.555458 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:31.567281 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:31.579286 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:31.590945 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:31.602725 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:31.742505 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:31.889067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:32.427779 run create_hlr_db(pid=3890): Launched 03:39:32.555911 bus /sierra_2: Setting Powered False 03:39:33.620158 run create_hlr_db(pid=3890): Terminated: ok {rc=0} 03:39:34.060794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Launched 03:39:34.370272 run osmo-hlr_10.42.42.2(pid=3893): Launched 03:39:34.486886 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:35.016253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Launched 03:39:35.323450 run osmo-stp_10.42.42.5(pid=3896): Launched 03:39:35.439533 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:35.994658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Launched 03:39:36.302677 run osmo-msc_10.42.42.6(pid=3899): Launched 03:39:36.473365 run osmo-stp_10.42.42.5(pid=3896): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] 03:39:36.602884 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-14_03:39:35.265121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:36.731812 run osmo-stp_10.42.42.5(pid=3896): stderr: | [0;m[38;5;43m20221214033935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033935440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033935440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033935441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033935441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:36.858796 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-14_03:39:35.265121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:36.979783 run osmo-stp_10.42.42.5(pid=3896): stderr: | [0;m[38;5;43m20221214033935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033935440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033935440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033935441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033935441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:37.124440 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:39:37.133461 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:39:37.159829 run osmo-hlr_10.42.42.2(pid=3893): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3893)] 03:39:37.207621 run osmo-hlr_10.42.42.2(pid=3893): stdout: | (launched: 2022-12-14_03:39:34.311603) 03:39:37.257101 run osmo-hlr_10.42.42.2(pid=3893): stderr: | [0;m[1;31m20221214033934489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033934489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033934489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033934490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033934490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033934490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033934505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033934515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033934515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033934515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:37.326253 run osmo-msc_10.42.42.6(pid=3899): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3899)] 03:39:37.374227 run osmo-msc_10.42.42.6(pid=3899): stdout: | (launched: 2022-12-14_03:39:36.244229) 03:39:37.423563 run osmo-msc_10.42.42.6(pid=3899): stderr: | [0;m[38;5;43m20221214033936520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033936520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99e6f3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033936520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033936520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033936521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033936521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033936523 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033936523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033936523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033936523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:37.473441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminating (SIGTERM) 03:39:37.513136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminating (SIGTERM) 03:39:37.552892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Terminating (SIGTERM) 03:39:37.592605 --- ParallelTerminationStrategy: PID 3892 died... 03:39:37.611731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminated: ok {rc=0} 03:39:37.655575 --- ParallelTerminationStrategy: PID 3895 died... 03:39:37.674558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminated: ok {rc=0} 03:39:37.718451 --- ParallelTerminationStrategy: PID 3898 died... 03:39:37.737091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3898): Terminated: ok {rc=0} 03:39:37.823373 bus /sierra_3: Setting Powered False 03:39:38.923946 bus /sierra_3: Setting Powered False 03:39:40.039054 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:39:41.190943 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.203848 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:39:41.265637 tst mo_mt_call_osmux.py: using LAC 38289 03:39:41.394712 tst mo_mt_call_osmux.py: using RAC 39 03:39:41.526558 tst mo_mt_call_osmux.py: using CellId 38289 03:39:41.654999 tst mo_mt_call_osmux.py: using BVCI 38290 03:39:41.775099 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.786717 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.798168 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.809544 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.821262 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:39:41.832898 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:41.953724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:39:42.071111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:42.550118 run create_hlr_db(pid=3901): Launched 03:39:42.676370 bus /sierra_2: Setting Powered False 03:39:43.737678 run create_hlr_db(pid=3901): Terminated: ok {rc=0} 03:39:44.184626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Launched 03:39:44.515877 run osmo-hlr_10.42.42.2(pid=3904): Launched 03:39:44.641907 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:45.208310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Launched 03:39:45.539171 run osmo-stp_10.42.42.5(pid=3907): Launched 03:39:45.664454 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:46.288455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Launched 03:39:46.634286 run osmo-msc_10.42.42.6(pid=3910): Launched 03:39:46.887250 run osmo-stp_10.42.42.5(pid=3907): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] 03:39:47.146181 run osmo-stp_10.42.42.5(pid=3907): stdout: | (launched: 2022-12-14_03:39:45.477297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:47.326031 run osmo-stp_10.42.42.5(pid=3907): stderr: | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033945673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:47.464277 run osmo-stp_10.42.42.5(pid=3907): stdout: | (launched: 2022-12-14_03:39:45.477297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:47.595197 run osmo-stp_10.42.42.5(pid=3907): stderr: | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033945673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033945673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033945674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:47.751310 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3907): Process ended prematurely: osmo-stp_10.42.42.5(pid=3907) [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:39:47.760814 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:39:47.789107 run osmo-hlr_10.42.42.2(pid=3904): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3904)] 03:39:47.840015 run osmo-hlr_10.42.42.2(pid=3904): stdout: | (launched: 2022-12-14_03:39:44.453727) 03:39:47.892570 run osmo-hlr_10.42.42.2(pid=3904): stderr: | [0;m[1;31m20221214033944656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033944656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033944656 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033944657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033944657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033944657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033944688 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033944698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033944698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033944698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:47.965285 run osmo-msc_10.42.42.6(pid=3910): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3910)] 03:39:48.015747 run osmo-msc_10.42.42.6(pid=3910): stdout: | (launched: 2022-12-14_03:39:46.571037) 03:39:48.068648 run osmo-msc_10.42.42.6(pid=3910): stderr: | [0;m[38;5;43m20221214033947133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033947134 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc36b9adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033947134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033947134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033947134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033947134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033947136 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033947136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033947136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033947136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:48.121652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Terminating (SIGTERM) 03:39:48.163374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Terminating (SIGTERM) 03:39:48.206349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Terminating (SIGTERM) 03:39:48.249009 --- ParallelTerminationStrategy: PID 3903 died... 03:39:48.269717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3903): Terminated: ok {rc=0} 03:39:48.316567 --- ParallelTerminationStrategy: PID 3906 died... 03:39:48.336689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3906): Terminated: ok {rc=0} 03:39:48.383434 --- ParallelTerminationStrategy: PID 3909 died... 03:39:48.403344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3909): Terminated: ok {rc=0} 03:39:48.491652 bus /sierra_3: Setting Powered False 03:39:49.590601 bus /sierra_3: Setting Powered False 03:39:50.709058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:39:51.943841 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:39:51.951018 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:39:51.972140 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:39:52.000437 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:39:52.054436 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:39:52.076629 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:39:52.104152 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:39:52.652288 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:39:52.702901 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:52.714111 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:39:52.776152 tst mo_mt_call.py: using LAC 38290 03:39:52.896361 tst mo_mt_call.py: using RAC 40 03:39:53.015978 tst mo_mt_call.py: using CellId 38290 03:39:53.135124 tst mo_mt_call.py: using BVCI 38291 03:39:53.247710 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:53.258793 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:53.269491 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:53.280003 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:53.290847 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:39:53.301698 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:53.418555 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:39:53.540183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:39:54.050105 run create_hlr_db(pid=3915): Launched 03:39:54.175487 bus /sierra_2: Setting Powered False 03:39:55.241177 run create_hlr_db(pid=3915): Terminated: ok {rc=0} 03:39:55.697910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3917): Launched 03:39:56.027806 run osmo-hlr_10.42.42.2(pid=3918): Launched 03:39:56.153707 run osmo-stp_10.42.42.5: Starting osmo-stp 03:39:56.719777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3920): Launched 03:39:57.051994 run osmo-stp_10.42.42.5(pid=3921): Launched 03:39:57.178583 run osmo-msc_10.42.42.6: Starting osmo-msc 03:39:57.773838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3923): Launched 03:39:58.102866 run osmo-msc_10.42.42.6(pid=3924): Launched 03:39:58.286910 run osmo-stp_10.42.42.5(pid=3921): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3921)] 03:39:58.425750 run osmo-stp_10.42.42.5(pid=3921): stdout: | (launched: 2022-12-14_03:39:56.990292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:58.564809 run osmo-stp_10.42.42.5(pid=3921): stderr: | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033957186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:58.703043 run osmo-stp_10.42.42.5(pid=3921): stdout: | (launched: 2022-12-14_03:39:56.990292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:39:58.833455 run osmo-stp_10.42.42.5(pid=3921): stderr: | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033957185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033957186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033957186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:39:58.989360 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3921): Process ended prematurely: osmo-stp_10.42.42.5(pid=3921) [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3921)] [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:39:58.998853 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:39:59.026625 run osmo-hlr_10.42.42.2(pid=3918): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3918)] 03:39:59.077204 run osmo-hlr_10.42.42.2(pid=3918): stdout: | (launched: 2022-12-14_03:39:55.966116) 03:39:59.129522 run osmo-hlr_10.42.42.2(pid=3918): stderr: | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033956166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033956178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033956186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033956186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033956186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:39:59.201747 run osmo-msc_10.42.42.6(pid=3924): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3924)] 03:39:59.251831 run osmo-msc_10.42.42.6(pid=3924): stdout: | (launched: 2022-12-14_03:39:58.041275) 03:39:59.304277 run osmo-msc_10.42.42.6(pid=3924): stderr: | [0;m[38;5;43m20221214033958365 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033958366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb8b36cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033958366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033958366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033958366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033958366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033958368 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033958368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033958368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033958369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:39:59.356274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3917): Terminating (SIGTERM) 03:39:59.398094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3920): Terminating (SIGTERM) 03:39:59.440467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3923): Terminating (SIGTERM) 03:39:59.482987 --- ParallelTerminationStrategy: PID 3917 died... 03:39:59.503523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3917): Terminated: ok {rc=0} 03:39:59.550515 --- ParallelTerminationStrategy: PID 3920 died... 03:39:59.570718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3920): Terminated: ok {rc=0} 03:39:59.617651 --- ParallelTerminationStrategy: PID 3923 died... 03:39:59.637918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3923): Terminated: ok {rc=0} 03:39:59.727290 bus /sierra_3: Setting Powered False 03:40:00.825735 bus /sierra_3: Setting Powered False 03:40:01.979887 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:40:03.144932 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.156728 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:40:03.215680 tst mo_mt_call_osmux.py: using LAC 38291 03:40:03.345721 tst mo_mt_call_osmux.py: using RAC 41 03:40:03.474076 tst mo_mt_call_osmux.py: using CellId 38291 03:40:03.601513 tst mo_mt_call_osmux.py: using BVCI 38292 03:40:03.720736 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.732235 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.743308 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.754366 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.765808 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:40:03.777271 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:03.894457 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:40:04.014931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:04.525924 run create_hlr_db(pid=3937): Launched 03:40:04.650808 bus /sierra_2: Setting Powered False 03:40:05.715678 run create_hlr_db(pid=3937): Terminated: ok {rc=0} 03:40:06.173507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Launched 03:40:06.503945 run osmo-hlr_10.42.42.2(pid=3940): Launched 03:40:06.630145 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:07.196469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Launched 03:40:07.528581 run osmo-stp_10.42.42.5(pid=3943): Launched 03:40:07.656586 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:08.251821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3945): Launched 03:40:08.582693 run osmo-msc_10.42.42.6(pid=3946): Launched 03:40:08.765467 run osmo-stp_10.42.42.5(pid=3943): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] 03:40:08.903471 run osmo-stp_10.42.42.5(pid=3943): stdout: | (launched: 2022-12-14_03:40:07.466602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:09.042660 run osmo-stp_10.42.42.5(pid=3943): stderr: | [0;m[38;5;43m20221214034007660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034007660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034007661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034007661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:09.180757 run osmo-stp_10.42.42.5(pid=3943): stdout: | (launched: 2022-12-14_03:40:07.466602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:09.311389 run osmo-stp_10.42.42.5(pid=3943): stderr: | [0;m[38;5;43m20221214034007660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034007660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034007661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034007661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034007664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:09.467383 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3943): Process ended prematurely: osmo-stp_10.42.42.5(pid=3943) [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:40:09.476850 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:40:09.504475 run osmo-hlr_10.42.42.2(pid=3940): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3940)] 03:40:09.554811 run osmo-hlr_10.42.42.2(pid=3940): stdout: | (launched: 2022-12-14_03:40:06.441860) 03:40:09.606892 run osmo-hlr_10.42.42.2(pid=3940): stderr: | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034006645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034006659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034006669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034006669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034006669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:09.679168 run osmo-msc_10.42.42.6(pid=3946): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3946)] 03:40:09.728906 run osmo-msc_10.42.42.6(pid=3946): stdout: | (launched: 2022-12-14_03:40:08.520412) 03:40:09.781146 run osmo-msc_10.42.42.6(pid=3946): stderr: | [0;m[38;5;43m20221214034008844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034008844 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe751988c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034008844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034008844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034008844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034008844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034008846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034008847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034008847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034008847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:09.833305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Terminating (SIGTERM) 03:40:09.874749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Terminating (SIGTERM) 03:40:09.916915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3945): Terminating (SIGTERM) 03:40:09.959470 --- ParallelTerminationStrategy: PID 3939 died... 03:40:09.979570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Terminated: ok {rc=0} 03:40:10.025945 --- ParallelTerminationStrategy: PID 3942 died... 03:40:10.045624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Terminated: ok {rc=0} 03:40:10.091925 --- ParallelTerminationStrategy: PID 3945 died... 03:40:10.111724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3945): Terminated: ok {rc=0} 03:40:10.199417 bus /sierra_3: Setting Powered False 03:40:11.299057 bus /sierra_3: Setting Powered False 03:40:12.416144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:sysmo --------------------------------------------------------------------- 03:40:13.659160 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:13.663833 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 03:40:13.684846 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 03:40:13.712581 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 03:40:13.795607 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 03:40:13.816671 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 03:40:13.844137 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 03:40:14.435470 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 03:40:14.442000 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:14.453605 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:40:14.490561 tst emergency_mo_mt_call.py: using LAC 38292 03:40:14.620254 tst emergency_mo_mt_call.py: using RAC 42 03:40:14.736299 tst emergency_mo_mt_call.py: using CellId 38292 03:40:14.851975 tst emergency_mo_mt_call.py: using BVCI 38293 03:40:14.959798 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:14.970665 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:14.981130 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:14.991419 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:15.001857 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:15.012676 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:15.131915 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:15.248677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:15.753141 run create_hlr_db(pid=4302): Launched 03:40:15.900542 bus /sierra_2: Setting Powered False 03:40:16.974728 run create_hlr_db(pid=4302): Terminated: ok {rc=0} 03:40:17.462930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4304): Launched 03:40:17.787831 run osmo-hlr_10.42.42.2(pid=4305): Launched 03:40:17.913766 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:18.434738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4307): Launched 03:40:18.739626 run osmo-stp_10.42.42.5(pid=4308): Launched 03:40:18.863571 tst emergency_mo_mt_call.py: using MSISDN 8490 03:40:19.030713 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:19.612832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4310): Launched 03:40:19.936167 run osmo-msc_10.42.42.6(pid=4311): Launched 03:40:20.116689 run osmo-stp_10.42.42.5(pid=4308): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4308)] 03:40:20.253432 run osmo-stp_10.42.42.5(pid=4308): stdout: | (launched: 2022-12-14_03:40:18.681933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:20.390486 run osmo-stp_10.42.42.5(pid=4308): stderr: | [0;m[38;5;43m20221214034018856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034018856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034018857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034018857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:20.526867 run osmo-stp_10.42.42.5(pid=4308): stdout: | (launched: 2022-12-14_03:40:18.681933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:20.655630 run osmo-stp_10.42.42.5(pid=4308): stderr: | [0;m[38;5;43m20221214034018856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034018856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034018857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034018857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034018858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:20.809066 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4308): Process ended prematurely: osmo-stp_10.42.42.5(pid=4308) [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4308)] [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py:19] 03:40:20.818083 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 03:40:20.845553 run osmo-hlr_10.42.42.2(pid=4305): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4305)] 03:40:20.896479 run osmo-hlr_10.42.42.2(pid=4305): stdout: | (launched: 2022-12-14_03:40:17.726801) 03:40:20.948890 run osmo-hlr_10.42.42.2(pid=4305): stderr: | [0;m[1;31m20221214034017926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034017926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034017926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034017926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034017926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034017927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034017939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034017947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034017947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034017947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:21.021086 run osmo-msc_10.42.42.6(pid=4311): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4311)] 03:40:21.071099 run osmo-msc_10.42.42.6(pid=4311): stdout: | (launched: 2022-12-14_03:40:19.875175) 03:40:21.123349 run osmo-msc_10.42.42.6(pid=4311): stderr: | [0;m[38;5;43m20221214034020200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034020201 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb105dc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034020201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034020201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034020201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034020201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034020203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034020203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034020204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034020204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:21.175738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4304): Terminating (SIGTERM) 03:40:21.217739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4307): Terminating (SIGTERM) 03:40:21.260279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4310): Terminating (SIGTERM) 03:40:21.303271 --- ParallelTerminationStrategy: PID 4304 died... 03:40:21.323948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4304): Terminated: ok {rc=0} 03:40:21.371002 --- ParallelTerminationStrategy: PID 4307 died... 03:40:21.391147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4307): Terminated: ok {rc=0} 03:40:21.437739 --- ParallelTerminationStrategy: PID 4310 died... 03:40:21.457736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4310): Terminated: ok {rc=0} 03:40:21.545693 bus /sierra_3: Setting Powered False 03:40:22.645285 bus /sierra_3: Setting Powered False 03:40:23.763284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 03:40:24.856524 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:24.870555 tst emergency:sysmo: Using 1 x bts (candidates: 1) 03:40:24.913223 tst emergency_preemptive_call.py: using LAC 38293 03:40:25.041790 tst emergency_preemptive_call.py: using RAC 43 03:40:25.176186 tst emergency_preemptive_call.py: using CellId 38293 03:40:25.305637 tst emergency_preemptive_call.py: using BVCI 38294 03:40:25.427443 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:25.439478 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:25.451369 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:25.464267 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:25.477460 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 03:40:25.490396 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:25.614000 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:25.739453 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:25.855889 tst emergency:sysmo: Using 1 x modem (candidates: 4) 03:40:25.971353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:26.481558 run create_hlr_db(pid=4490): Launched 03:40:26.643778 bus /sierra_2: Setting Powered False 03:40:27.709846 run create_hlr_db(pid=4490): Terminated: ok {rc=0} 03:40:28.171133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Launched 03:40:28.521481 run osmo-hlr_10.42.42.2(pid=4493): Launched 03:40:28.777106 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:29.446610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4496): Launched 03:40:29.772123 run osmo-stp_10.42.42.5(pid=4497): Launched 03:40:29.905222 tst emergency_preemptive_call.py: using MSISDN 8491 03:40:30.078187 run osmo-msc_10.42.42.6: Starting osmo-msc 03:40:30.660236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4499): Launched 03:40:31.027883 run osmo-msc_10.42.42.6(pid=4500): Launched 03:40:31.478643 run osmo-stp_10.42.42.5(pid=4497): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4497)] 03:40:31.645491 run osmo-stp_10.42.42.5(pid=4497): stdout: | (launched: 2022-12-14_03:40:29.711268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:31.830649 run osmo-stp_10.42.42.5(pid=4497): stderr: | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034029909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:32.006874 run osmo-stp_10.42.42.5(pid=4497): stdout: | (launched: 2022-12-14_03:40:29.711268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:32.137592 run osmo-stp_10.42.42.5(pid=4497): stderr: | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034029908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034029909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034029909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:32.295845 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4497): Process ended prematurely: osmo-stp_10.42.42.5(pid=4497) [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4497)] [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py:32] 03:40:32.305422 tst emergency_preemptive_call.py:32: Test FAILED (7.4 sec) 03:40:32.333488 run osmo-hlr_10.42.42.2(pid=4493): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4493)] 03:40:32.386496 run osmo-hlr_10.42.42.2(pid=4493): stdout: | (launched: 2022-12-14_03:40:28.458207) 03:40:32.438835 run osmo-hlr_10.42.42.2(pid=4493): stderr: | [0;m[1;31m20221214034028769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034028769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034028769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034028769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034028769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034028770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034028794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034028802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034028802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034028802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:32.512102 run osmo-msc_10.42.42.6(pid=4500): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4500)] 03:40:32.562300 run osmo-msc_10.42.42.6(pid=4500): stdout: | (launched: 2022-12-14_03:40:30.958193) 03:40:32.615071 run osmo-msc_10.42.42.6(pid=4500): stderr: | [0;m[38;5;43m20221214034031501 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034031502 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8175ec3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034031502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034031502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034031502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034031502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034031504 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034031504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034031505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034031505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:40:32.668227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminating (SIGTERM) 03:40:32.710104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4496): Terminating (SIGTERM) 03:40:32.752790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4499): Terminating (SIGTERM) 03:40:32.795444 --- ParallelTerminationStrategy: PID 4492 died... 03:40:32.816015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4492): Terminated: ok {rc=0} 03:40:32.862916 --- ParallelTerminationStrategy: PID 4496 died... 03:40:32.883271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4496): Terminated: ok {rc=0} 03:40:32.930229 --- ParallelTerminationStrategy: PID 4499 died... 03:40:32.950447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4499): Terminated: ok {rc=0} 03:40:33.039649 bus /sierra_9: Setting Powered False 03:40:34.138581 bus /sierra_9: Setting Powered False 03:40:35.256377 bus /sierra_8: Setting Powered False 03:40:36.355850 bus /sierra_8: Setting Powered False 03:40:37.472806 bus /sierra_3: Setting Powered False 03:40:38.570933 bus /sierra_3: Setting Powered False 03:40:39.688443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:sysmo --------------------------------------------------------------------- 03:40:40.946598 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:40:40.950798 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 03:40:40.971329 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 03:40:41.009592 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 03:40:41.096584 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 03:40:41.117325 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 03:40:41.155718 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 03:40:41.743823 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 03:40:41.800575 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:41.811743 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:41.847395 tst cs_paging_gprs_active.py: using LAC 38294 03:40:41.977536 tst cs_paging_gprs_active.py: using RAC 44 03:40:42.101944 tst cs_paging_gprs_active.py: using CellId 38294 03:40:42.221199 tst cs_paging_gprs_active.py: using BVCI 38295 03:40:42.331646 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.342206 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.352507 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.362792 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.372925 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.383203 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.393511 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.403805 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:42.414449 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:42.536730 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:42.655117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:40:42.861843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:43.172143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4506): Launched 03:40:43.440351 run iperf3-srv_10.42.42.10(pid=4507): Launched 03:40:43.555040 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:40:43.759612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:44.067913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4508): Launched 03:40:44.336620 run iperf3-srv_10.42.42.10(pid=4509): Launched 03:40:44.451146 tst cs_paging_gprs_active.py:38: start network... 03:40:44.655121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:45.134785 run create_hlr_db(pid=4510): Launched 03:40:45.259891 bus /sierra_2: Setting Powered False 03:40:46.329319 run create_hlr_db(pid=4510): Terminated: ok {rc=0} 03:40:46.830209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4512): Launched 03:40:47.229660 run osmo-hlr_10.42.42.2(pid=4513): Launched 03:40:47.366538 run osmo-stp_10.42.42.5: Starting osmo-stp 03:40:47.942529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4515): Launched 03:40:48.273436 run osmo-stp_10.42.42.5(pid=4516): Launched 03:40:48.400512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:40:49.972433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4518): Launched 03:40:50.098253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:40:50.378273 run patchelf(pid=4519): Launched 03:40:50.561690 run osmo-stp_10.42.42.5(pid=4516): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4516)] 03:40:50.700817 run osmo-stp_10.42.42.5(pid=4516): stdout: | (launched: 2022-12-14_03:40:48.211064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:50.842091 run osmo-stp_10.42.42.5(pid=4516): stderr: | [0;m[38;5;43m20221214034048407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034048407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034048408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034048408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:50.983076 run osmo-stp_10.42.42.5(pid=4516): stdout: | (launched: 2022-12-14_03:40:48.211064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:40:51.118187 run osmo-stp_10.42.42.5(pid=4516): stderr: | [0;m[38;5;43m20221214034048407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034048407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034048408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034048408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034048409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:40:51.278772 run patchelf(pid=4519): Terminating (SIGINT) 03:40:51.462824 run patchelf(pid=4519): Terminated: ok {rc=0} 03:40:51.595638 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4516): Process ended prematurely: osmo-stp_10.42.42.5(pid=4516) [trial-2399↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4516)] [trial-2399↪gprs:sysmo↪cs_paging_gprs_active.py:38] 03:40:51.605710 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 03:40:51.634316 run osmo-hlr_10.42.42.2(pid=4513): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4513)] 03:40:51.684817 run osmo-hlr_10.42.42.2(pid=4513): stdout: | (launched: 2022-12-14_03:40:47.165190) 03:40:51.736358 run osmo-hlr_10.42.42.2(pid=4513): stderr: | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034047380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034047392 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034047400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034047400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034047400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:40:51.788615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4506): Terminating (SIGTERM) 03:40:51.831055 run iperf3-srv_10.42.42.10(pid=4507): Terminating (SIGTERM) 03:40:51.874521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4508): Terminating (SIGTERM) 03:40:51.917373 run iperf3-srv_10.42.42.10(pid=4509): Terminating (SIGTERM) 03:40:51.961576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4512): Terminating (SIGTERM) 03:40:52.002047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4515): Terminating (SIGTERM) 03:40:52.045949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4518): Terminating (SIGTERM) 03:40:52.088266 --- ParallelTerminationStrategy: PID 4506 died... 03:40:52.108518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4506): Terminated: ok {rc=0} 03:40:52.155469 --- ParallelTerminationStrategy: PID 4507 died... 03:40:52.175684 run iperf3-srv_10.42.42.10(pid=4507): Terminated {rc=256} 03:40:52.222223 --- ParallelTerminationStrategy: PID 4508 died... 03:40:52.242563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4508): Terminated: ok {rc=0} 03:40:52.289392 --- ParallelTerminationStrategy: PID 4509 died... 03:40:52.309588 run iperf3-srv_10.42.42.10(pid=4509): Terminated {rc=256} 03:40:52.356140 --- ParallelTerminationStrategy: PID 4512 died... 03:40:52.376348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4512): Terminated: ok {rc=0} 03:40:52.422947 --- ParallelTerminationStrategy: PID 4515 died... 03:40:52.443112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4515): Terminated: ok {rc=0} 03:40:52.490145 --- ParallelTerminationStrategy: PID 4518 died... 03:40:52.510552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4518): Terminated: ok {rc=0} 03:40:52.599967 bus /gobi_0: Setting Powered False 03:40:53.699272 bus /gobi_0: Setting Powered False 03:40:54.816068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo iperf3.py ---------------------------------------------- 03:40:55.968119 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:55.979930 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:40:56.016832 tst iperf3.py: using LAC 38295 03:40:56.138760 tst iperf3.py: using RAC 45 03:40:56.260622 tst iperf3.py: using CellId 38295 03:40:56.390840 tst iperf3.py: using BVCI 38296 03:40:56.511836 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.523054 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.534146 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.545073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.556184 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.567188 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.578395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.589575 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:40:56.600694 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:40:56.718253 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:40:56.925009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:40:57.234524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4521): Launched 03:40:57.501991 run iperf3-srv_10.42.42.10(pid=4522): Launched 03:40:57.616715 tst iperf3.py:8: start network... 03:40:57.822924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:40:58.300045 run create_hlr_db(pid=4523): Launched 03:40:58.426306 bus /gobi_6: Setting Powered False 03:40:59.487284 run create_hlr_db(pid=4523): Terminated: ok {rc=0} 03:40:59.914436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Launched 03:41:00.222061 run osmo-hlr_10.42.42.2(pid=4526): Launched 03:41:00.338152 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:00.871422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Launched 03:41:01.240631 run osmo-stp_10.42.42.5(pid=4529): Launched 03:41:01.460224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:02.213160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4531): Launched 03:41:02.354002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:02.636385 run patchelf(pid=4532): Launched 03:41:02.819363 run osmo-stp_10.42.42.5(pid=4529): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] 03:41:02.959875 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-14_03:41:01.175606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:03.101626 run osmo-stp_10.42.42.5(pid=4529): stderr: | [0;m[38;5;43m20221214034101508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034101509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034101509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034101509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034101511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034101512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034101512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:03.242572 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-14_03:41:01.175606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:03.377721 run osmo-stp_10.42.42.5(pid=4529): stderr: | [0;m[38;5;43m20221214034101508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034101509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034101509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034101509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034101511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034101512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034101512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:03.537612 run patchelf(pid=4532): Terminating (SIGINT) 03:41:03.720923 run patchelf(pid=4532): Terminated: ok {rc=0} 03:41:03.853311 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2399↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] [trial-2399↪gprs:sysmo↪iperf3.py:8] 03:41:03.863471 tst iperf3.py:8: Test FAILED (7.9 sec) 03:41:03.892048 run osmo-hlr_10.42.42.2(pid=4526): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4526)] 03:41:03.942910 run osmo-hlr_10.42.42.2(pid=4526): stdout: | (launched: 2022-12-14_03:41:00.163417) 03:41:03.995523 run osmo-hlr_10.42.42.2(pid=4526): stderr: | [0;m[1;31m20221214034100345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034100345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034100345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034100345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034100345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034100346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034100377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034100387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034100387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034100387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:04.048493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4521): Terminating (SIGTERM) 03:41:04.090361 run iperf3-srv_10.42.42.10(pid=4522): Terminating (SIGTERM) 03:41:04.133064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminating (SIGTERM) 03:41:04.175358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminating (SIGTERM) 03:41:04.217483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4531): Terminating (SIGTERM) 03:41:04.260150 --- ParallelTerminationStrategy: PID 4521 died... 03:41:04.280582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4521): Terminated: ok {rc=0} 03:41:04.327326 --- ParallelTerminationStrategy: PID 4522 died... 03:41:04.347329 run iperf3-srv_10.42.42.10(pid=4522): Terminated {rc=256} 03:41:04.394019 --- ParallelTerminationStrategy: PID 4525 died... 03:41:04.413926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminated: ok {rc=0} 03:41:04.460527 --- ParallelTerminationStrategy: PID 4528 died... 03:41:04.480570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminated: ok {rc=0} 03:41:04.527241 --- ParallelTerminationStrategy: PID 4531 died... 03:41:04.547258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4531): Terminated: ok {rc=0} 03:41:04.635938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo iperf3m4.py ---------------------------------------------- 03:41:05.787427 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:05.799416 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:05.835941 tst iperf3m4.py: using LAC 38296 03:41:05.955769 tst iperf3m4.py: using RAC 46 03:41:06.076826 tst iperf3m4.py: using CellId 38296 03:41:06.206749 tst iperf3m4.py: using BVCI 38297 03:41:06.329340 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.340584 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.351746 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.362975 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.374461 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.385925 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.397690 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.409220 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:06.420852 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:06.542870 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:06.665636 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:06.784346 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:06.904813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:07.127245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:07.460757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4533): Launched 03:41:07.750350 run iperf3-srv_10.42.42.10(pid=4534): Launched 03:41:07.874550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:41:08.097124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:08.431184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4535): Launched 03:41:08.719712 run iperf3-srv_10.42.42.10(pid=4536): Launched 03:41:08.843568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:41:09.065826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:09.399489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4537): Launched 03:41:09.688050 run iperf3-srv_10.42.42.10(pid=4538): Launched 03:41:09.811613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:41:10.032857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:10.365364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4539): Launched 03:41:10.672018 run iperf3-srv_10.42.42.10(pid=4540): Launched 03:41:10.786933 tst iperf3m4.py:8: start network... 03:41:10.991906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:11.474053 run create_hlr_db(pid=4541): Launched 03:41:11.598672 bus /gobi_6: Setting Powered False 03:41:12.659606 run create_hlr_db(pid=4541): Terminated: ok {rc=0} 03:41:13.088619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Launched 03:41:13.397100 run osmo-hlr_10.42.42.2(pid=4544): Launched 03:41:13.512871 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:14.055654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Launched 03:41:14.363261 run osmo-stp_10.42.42.5(pid=4547): Launched 03:41:14.479860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:15.007086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Launched 03:41:15.124058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:15.384334 run patchelf(pid=4550): Launched 03:41:15.554460 run osmo-stp_10.42.42.5(pid=4547): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] 03:41:15.683736 run osmo-stp_10.42.42.5(pid=4547): stdout: | (launched: 2022-12-14_03:41:14.304491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:15.814563 run osmo-stp_10.42.42.5(pid=4547): stderr: | [0;m[38;5;43m20221214034114479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034114480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034114480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034114480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:15.983363 run osmo-stp_10.42.42.5(pid=4547): stdout: | (launched: 2022-12-14_03:41:14.304491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:16.124106 run osmo-stp_10.42.42.5(pid=4547): stderr: | [0;m[38;5;43m20221214034114479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034114480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034114480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034114480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034114481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:16.290723 run patchelf(pid=4550): Terminating (SIGINT) 03:41:16.482634 run patchelf(pid=4550): Terminated: ok {rc=0} 03:41:16.632365 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4547): Process ended prematurely: osmo-stp_10.42.42.5(pid=4547) [trial-2399↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] [trial-2399↪gprs:sysmo↪iperf3m4.py:8] 03:41:16.643902 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:41:16.677231 run osmo-hlr_10.42.42.2(pid=4544): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4544)] 03:41:16.732231 run osmo-hlr_10.42.42.2(pid=4544): stdout: | (launched: 2022-12-14_03:41:13.338013) 03:41:16.787667 run osmo-hlr_10.42.42.2(pid=4544): stderr: | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034113520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034113533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034113542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034113542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034113542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:16.843693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4533): Terminating (SIGTERM) 03:41:16.888686 run iperf3-srv_10.42.42.10(pid=4534): Terminating (SIGTERM) 03:41:16.934861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4535): Terminating (SIGTERM) 03:41:16.979062 run iperf3-srv_10.42.42.10(pid=4536): Terminating (SIGTERM) 03:41:17.023344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4537): Terminating (SIGTERM) 03:41:17.067608 run iperf3-srv_10.42.42.10(pid=4538): Terminating (SIGTERM) 03:41:17.113638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4539): Terminating (SIGTERM) 03:41:17.157890 run iperf3-srv_10.42.42.10(pid=4540): Terminating (SIGTERM) 03:41:17.202332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Terminating (SIGTERM) 03:41:17.245323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Terminating (SIGTERM) 03:41:17.288339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Terminating (SIGTERM) 03:41:17.331459 --- ParallelTerminationStrategy: PID 4533 died... 03:41:17.352499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4533): Terminated: ok {rc=0} 03:41:17.400347 --- ParallelTerminationStrategy: PID 4534 died... 03:41:17.421213 run iperf3-srv_10.42.42.10(pid=4534): Terminated {rc=256} 03:41:17.468718 --- ParallelTerminationStrategy: PID 4535 died... 03:41:17.489663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4535): Terminated: ok {rc=0} 03:41:17.537357 --- ParallelTerminationStrategy: PID 4536 died... 03:41:17.558215 run iperf3-srv_10.42.42.10(pid=4536): Terminated {rc=256} 03:41:17.605667 --- ParallelTerminationStrategy: PID 4537 died... 03:41:17.626377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4537): Terminated: ok {rc=0} 03:41:17.673720 --- ParallelTerminationStrategy: PID 4538 died... 03:41:17.694489 run iperf3-srv_10.42.42.10(pid=4538): Terminated {rc=256} 03:41:17.741359 --- ParallelTerminationStrategy: PID 4539 died... 03:41:17.761870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4539): Terminated: ok {rc=0} 03:41:17.808779 --- ParallelTerminationStrategy: PID 4540 died... 03:41:17.829697 run iperf3-srv_10.42.42.10(pid=4540): Terminated {rc=256} 03:41:17.876575 --- ParallelTerminationStrategy: PID 4543 died... 03:41:17.897067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4543): Terminated: ok {rc=0} 03:41:17.944429 --- ParallelTerminationStrategy: PID 4546 died... 03:41:17.965183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4546): Terminated: ok {rc=0} 03:41:18.012697 --- ParallelTerminationStrategy: PID 4549 died... 03:41:18.033367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4549): Terminated: ok {rc=0} 03:41:18.122714 bus /gobi_4: Setting Powered False 03:41:19.222709 bus /gobi_4: Setting Powered False 03:41:20.339856 bus /gobi_1: Setting Powered False 03:41:21.438763 bus /gobi_1: Setting Powered False 03:41:22.554903 bus /gobi_0: Setting Powered False 03:41:23.658652 bus /gobi_0: Setting Powered False 03:41:24.779175 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo ping.py ---------------------------------------------- 03:41:25.882947 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:25.894430 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:25.987193 tst ping.py: using LAC 38297 03:41:26.110065 tst ping.py: using RAC 47 03:41:26.229058 tst ping.py: using CellId 38297 03:41:26.348509 tst ping.py: using BVCI 38298 03:41:26.459412 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.470144 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.480639 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.491214 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.501902 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.512246 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.523318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:26.533886 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:26.650749 tst ping.py:19: start network... 03:41:26.851464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:27.322210 run create_hlr_db(pid=4551): Launched 03:41:27.444715 bus /gobi_6: Setting Powered False 03:41:28.504771 run create_hlr_db(pid=4551): Terminated: ok {rc=0} 03:41:28.949259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4553): Launched 03:41:29.275138 run osmo-hlr_10.42.42.2(pid=4554): Launched 03:41:29.398532 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:29.957531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4556): Launched 03:41:30.260211 run osmo-stp_10.42.42.5(pid=4557): Launched 03:41:30.372896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:30.917953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4559): Launched 03:41:31.086234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:31.399416 run patchelf(pid=4560): Launched 03:41:31.587821 run osmo-stp_10.42.42.5(pid=4557): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4557)] 03:41:31.717708 run osmo-stp_10.42.42.5(pid=4557): stdout: | (launched: 2022-12-14_03:41:30.202460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:31.849404 run osmo-stp_10.42.42.5(pid=4557): stderr: | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034130376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:31.981890 run osmo-stp_10.42.42.5(pid=4557): stdout: | (launched: 2022-12-14_03:41:30.202460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:32.107402 run osmo-stp_10.42.42.5(pid=4557): stderr: | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034130375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034130376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034130378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:32.255632 run patchelf(pid=4560): Terminating (SIGINT) 03:41:32.426095 run patchelf(pid=4560): Terminated: ok {rc=0} 03:41:32.547854 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4557): Process ended prematurely: osmo-stp_10.42.42.5(pid=4557) [trial-2399↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4557)] [trial-2399↪gprs:sysmo↪ping.py:22] 03:41:32.557046 tst ping.py:22: Test FAILED (6.7 sec) 03:41:32.584243 run osmo-hlr_10.42.42.2(pid=4554): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4554)] 03:41:32.633125 run osmo-hlr_10.42.42.2(pid=4554): stdout: | (launched: 2022-12-14_03:41:29.213483) 03:41:32.683335 run osmo-hlr_10.42.42.2(pid=4554): stderr: | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034129412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034129426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034129434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034129435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034129435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:32.733816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4553): Terminating (SIGTERM) 03:41:32.774724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4556): Terminating (SIGTERM) 03:41:32.815256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4559): Terminating (SIGTERM) 03:41:32.856056 --- ParallelTerminationStrategy: PID 4553 died... 03:41:32.875963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4553): Terminated: ok {rc=0} 03:41:32.921118 --- ParallelTerminationStrategy: PID 4556 died... 03:41:32.940177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4556): Terminated: ok {rc=0} 03:41:32.985319 --- ParallelTerminationStrategy: PID 4559 died... 03:41:33.004494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4559): Terminated: ok {rc=0} 03:41:33.091856 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 03:41:34.181939 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.193746 tst gprs:sysmo: Using 1 x bts (candidates: 1) 03:41:34.230563 tst ping_idle_ping.py: using LAC 38298 03:41:34.351566 tst ping_idle_ping.py: using RAC 48 03:41:34.481197 tst ping_idle_ping.py: using CellId 38298 03:41:34.607561 tst ping_idle_ping.py: using BVCI 38299 03:41:34.726424 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.737621 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.748420 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.759241 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.770394 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.781399 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.792577 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 03:41:34.803743 tst gprs:sysmo: Using 1 x modem (candidates: 4) 03:41:34.926926 tst ping_idle_ping.py:24: start network... 03:41:35.129333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:35.601195 run create_hlr_db(pid=4561): Launched 03:41:35.724778 bus /gobi_6: Setting Powered False 03:41:36.784633 run create_hlr_db(pid=4561): Terminated: ok {rc=0} 03:41:37.206487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Launched 03:41:37.509164 run osmo-hlr_10.42.42.2(pid=4564): Launched 03:41:37.623171 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:38.144622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Launched 03:41:38.446959 run osmo-stp_10.42.42.5(pid=4567): Launched 03:41:38.561182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:39.084686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4569): Launched 03:41:39.200447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:39.458681 run patchelf(pid=4570): Launched 03:41:39.625992 run osmo-stp_10.42.42.5(pid=4567): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] 03:41:39.753570 run osmo-stp_10.42.42.5(pid=4567): stdout: | (launched: 2022-12-14_03:41:38.389448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:39.882948 run osmo-stp_10.42.42.5(pid=4567): stderr: | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034138565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:40.012445 run osmo-stp_10.42.42.5(pid=4567): stdout: | (launched: 2022-12-14_03:41:38.389448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:40.136192 run osmo-stp_10.42.42.5(pid=4567): stderr: | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034138564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034138565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034138565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:40.282432 run patchelf(pid=4570): Terminating (SIGINT) 03:41:40.451565 run patchelf(pid=4570): Terminated: ok {rc=0} 03:41:40.572855 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4567): Process ended prematurely: osmo-stp_10.42.42.5(pid=4567) [trial-2399↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] [trial-2399↪gprs:sysmo↪ping_idle_ping.py:27] 03:41:40.581872 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:41:40.608352 run osmo-hlr_10.42.42.2(pid=4564): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4564)] 03:41:40.655614 run osmo-hlr_10.42.42.2(pid=4564): stdout: | (launched: 2022-12-14_03:41:37.451642) 03:41:40.704270 run osmo-hlr_10.42.42.2(pid=4564): stderr: | [0;m[1;31m20221214034137627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034137627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034137628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034137628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034137628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034137628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034137639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034137648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034137648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034137648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:40.753557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Terminating (SIGTERM) 03:41:40.792647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Terminating (SIGTERM) 03:41:40.831826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4569): Terminating (SIGTERM) 03:41:40.871169 --- ParallelTerminationStrategy: PID 4563 died... 03:41:40.890174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4563): Terminated: ok {rc=0} 03:41:40.933692 --- ParallelTerminationStrategy: PID 4566 died... 03:41:40.952001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4566): Terminated: ok {rc=0} 03:41:40.995394 --- ParallelTerminationStrategy: PID 4569 died... 03:41:41.013812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4569): Terminated: ok {rc=0} 03:41:41.097949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 03:41:42.381857 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:41:42.387009 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:41:42.407567 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:41:42.446067 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:41:42.532720 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:41:42.553347 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:41:42.591159 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:41:43.188235 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:41:43.238633 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.249824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:43.290726 tst cs_paging_gprs_active.py: using LAC 38299 03:41:43.411677 tst cs_paging_gprs_active.py: using RAC 49 03:41:43.530785 tst cs_paging_gprs_active.py: using CellId 38299 03:41:43.650862 tst cs_paging_gprs_active.py: using BVCI 38300 03:41:43.763909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.774802 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.785415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.795779 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.806184 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.816577 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.827290 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.837718 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:43.848258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:43.969710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:44.087382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:41:44.294528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:44.604314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4574): Launched 03:41:44.874311 run iperf3-srv_10.42.42.10(pid=4575): Launched 03:41:44.989412 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:41:45.207284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:45.542930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4576): Launched 03:41:45.837631 run iperf3-srv_10.42.42.10(pid=4577): Launched 03:41:45.983152 tst cs_paging_gprs_active.py:38: start network... 03:41:46.259668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:46.757990 run create_hlr_db(pid=4578): Launched 03:41:46.918242 bus /gobi_6: Setting Powered False 03:41:47.983105 run create_hlr_db(pid=4578): Terminated: ok {rc=0} 03:41:48.443992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4580): Launched 03:41:48.775108 run osmo-hlr_10.42.42.2(pid=4581): Launched 03:41:48.900029 run osmo-stp_10.42.42.5: Starting osmo-stp 03:41:49.471590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4583): Launched 03:41:49.802660 run osmo-stp_10.42.42.5(pid=4584): Launched 03:41:49.927771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:41:50.498473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4586): Launched 03:41:50.624548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:41:50.904448 run patchelf(pid=4587): Launched 03:41:51.087941 run osmo-stp_10.42.42.5(pid=4584): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4584)] 03:41:51.227985 run osmo-stp_10.42.42.5(pid=4584): stdout: | (launched: 2022-12-14_03:41:49.740185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:51.369996 run osmo-stp_10.42.42.5(pid=4584): stderr: | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034149938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:51.511842 run osmo-stp_10.42.42.5(pid=4584): stdout: | (launched: 2022-12-14_03:41:49.740185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:41:51.647522 run osmo-stp_10.42.42.5(pid=4584): stderr: | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034149938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034149938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034149939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:41:51.807853 run patchelf(pid=4587): Terminating (SIGINT) 03:41:51.992264 run patchelf(pid=4587): Terminated: ok {rc=0} 03:41:52.125378 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4584): Process ended prematurely: osmo-stp_10.42.42.5(pid=4584) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4584)] [trial-2399↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:41:52.135735 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:41:52.164539 run osmo-hlr_10.42.42.2(pid=4581): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4581)] 03:41:52.216031 run osmo-hlr_10.42.42.2(pid=4581): stdout: | (launched: 2022-12-14_03:41:48.713207) 03:41:52.269103 run osmo-hlr_10.42.42.2(pid=4581): stderr: | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034148915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034148927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034148935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034148935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034148935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:41:52.321960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4574): Terminating (SIGTERM) 03:41:52.364156 run iperf3-srv_10.42.42.10(pid=4575): Terminating (SIGTERM) 03:41:52.406749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4576): Terminating (SIGTERM) 03:41:52.449302 run iperf3-srv_10.42.42.10(pid=4577): Terminating (SIGTERM) 03:41:52.491681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4580): Terminating (SIGTERM) 03:41:52.534486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4583): Terminating (SIGTERM) 03:41:52.577001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4586): Terminating (SIGTERM) 03:41:52.619756 --- ParallelTerminationStrategy: PID 4574 died... 03:41:52.640466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4574): Terminated: ok {rc=0} 03:41:52.687816 --- ParallelTerminationStrategy: PID 4575 died... 03:41:52.707817 run iperf3-srv_10.42.42.10(pid=4575): Terminated {rc=256} 03:41:52.754578 --- ParallelTerminationStrategy: PID 4576 died... 03:41:52.774752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4576): Terminated: ok {rc=0} 03:41:52.821469 --- ParallelTerminationStrategy: PID 4577 died... 03:41:52.841494 run iperf3-srv_10.42.42.10(pid=4577): Terminated {rc=256} 03:41:52.888329 --- ParallelTerminationStrategy: PID 4580 died... 03:41:52.908371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4580): Terminated: ok {rc=0} 03:41:52.955008 --- ParallelTerminationStrategy: PID 4583 died... 03:41:52.975088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4583): Terminated: ok {rc=0} 03:41:53.021712 --- ParallelTerminationStrategy: PID 4586 died... 03:41:53.041619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4586): Terminated: ok {rc=0} 03:41:53.130125 bus /gobi_0: Setting Powered False 03:41:54.228910 bus /gobi_0: Setting Powered False 03:41:55.345332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:41:56.494032 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:56.505513 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:41:56.542536 tst iperf3.py: using LAC 38300 03:41:56.662648 tst iperf3.py: using RAC 50 03:41:56.782438 tst iperf3.py: using CellId 38300 03:41:56.904923 tst iperf3.py: using BVCI 38301 03:41:57.017719 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.028358 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.039085 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.049643 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.060036 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.071118 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.082061 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.092797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:41:57.103726 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:41:57.219498 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:41:57.425214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:41:57.734715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4588): Launched 03:41:58.002448 run iperf3-srv_10.42.42.10(pid=4589): Launched 03:41:58.116898 tst iperf3.py:8: start network... 03:41:58.320778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:41:58.797429 run create_hlr_db(pid=4590): Launched 03:41:58.923487 bus /gobi_6: Setting Powered False 03:41:59.984222 run create_hlr_db(pid=4590): Terminated: ok {rc=0} 03:42:00.433864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4592): Launched 03:42:00.764850 run osmo-hlr_10.42.42.2(pid=4593): Launched 03:42:01.026361 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:01.671030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4601): Launched 03:42:01.992830 run osmo-stp_10.42.42.5(pid=4602): Launched 03:42:02.234350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:02.811308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4604): Launched 03:42:02.928832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:03.191116 run patchelf(pid=4605): Launched 03:42:03.362376 run osmo-stp_10.42.42.5(pid=4602): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4602)] 03:42:03.493250 run osmo-stp_10.42.42.5(pid=4602): stdout: | (launched: 2022-12-14_03:42:01.929626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:03.623763 run osmo-stp_10.42.42.5(pid=4602): stderr: | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034202268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:03.754538 run osmo-stp_10.42.42.5(pid=4602): stdout: | (launched: 2022-12-14_03:42:01.929626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:03.879643 run osmo-stp_10.42.42.5(pid=4602): stderr: | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034202267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034202268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034202268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:04.027248 run patchelf(pid=4605): Terminating (SIGINT) 03:42:04.198020 run patchelf(pid=4605): Terminated: ok {rc=0} 03:42:04.321217 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4602): Process ended prematurely: osmo-stp_10.42.42.5(pid=4602) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4602)] [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 03:42:04.330709 tst iperf3.py:8: Test FAILED (7.9 sec) 03:42:04.357797 run osmo-hlr_10.42.42.2(pid=4593): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4593)] 03:42:04.405755 run osmo-hlr_10.42.42.2(pid=4593): stdout: | (launched: 2022-12-14_03:42:00.702998) 03:42:04.454850 run osmo-hlr_10.42.42.2(pid=4593): stderr: | [0;m[1;31m20221214034201040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034201040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034201040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034201041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034201041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034201048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034201109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034201120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034201120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034201120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:04.504523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4588): Terminating (SIGTERM) 03:42:04.543906 run iperf3-srv_10.42.42.10(pid=4589): Terminating (SIGTERM) 03:42:04.583066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4592): Terminating (SIGTERM) 03:42:04.622723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4601): Terminating (SIGTERM) 03:42:04.661908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4604): Terminating (SIGTERM) 03:42:04.701356 --- ParallelTerminationStrategy: PID 4588 died... 03:42:04.720280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4588): Terminated: ok {rc=0} 03:42:04.763660 --- ParallelTerminationStrategy: PID 4589 died... 03:42:04.782136 run iperf3-srv_10.42.42.10(pid=4589): Terminated {rc=256} 03:42:04.825387 --- ParallelTerminationStrategy: PID 4592 died... 03:42:04.843641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4592): Terminated: ok {rc=0} 03:42:04.887169 --- ParallelTerminationStrategy: PID 4601 died... 03:42:04.905778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4601): Terminated: ok {rc=0} 03:42:04.949235 --- ParallelTerminationStrategy: PID 4604 died... 03:42:04.967549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4604): Terminated: ok {rc=0} 03:42:05.052847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:42:06.199588 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.211078 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:06.248133 tst iperf3m4.py: using LAC 38301 03:42:06.368853 tst iperf3m4.py: using RAC 51 03:42:06.490458 tst iperf3m4.py: using CellId 38301 03:42:06.612212 tst iperf3m4.py: using BVCI 38302 03:42:06.724739 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.735579 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.746258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.756768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.767318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.777782 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.788411 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.798891 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:06.809497 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:06.926222 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:07.046534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:07.168556 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:07.285244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:07.491061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:07.801501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4606): Launched 03:42:08.070738 run iperf3-srv_10.42.42.10(pid=4607): Launched 03:42:08.185468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:42:08.389465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:08.698527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4608): Launched 03:42:08.966491 run iperf3-srv_10.42.42.10(pid=4609): Launched 03:42:09.081210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:42:09.285274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:09.595912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Launched 03:42:09.864416 run iperf3-srv_10.42.42.10(pid=4611): Launched 03:42:09.979133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:42:10.182746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:10.491691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Launched 03:42:10.759766 run iperf3-srv_10.42.42.10(pid=4613): Launched 03:42:10.874395 tst iperf3m4.py:8: start network... 03:42:11.077951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:11.556732 run create_hlr_db(pid=4614): Launched 03:42:11.682522 bus /gobi_6: Setting Powered False 03:42:12.747568 run create_hlr_db(pid=4614): Terminated: ok {rc=0} 03:42:13.186715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4616): Launched 03:42:13.494639 run osmo-hlr_10.42.42.2(pid=4617): Launched 03:42:13.610322 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:14.156045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4619): Launched 03:42:14.465188 run osmo-stp_10.42.42.5(pid=4620): Launched 03:42:14.582461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:15.111139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4622): Launched 03:42:15.227488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:15.487552 run patchelf(pid=4623): Launched 03:42:15.658322 run osmo-stp_10.42.42.5(pid=4620): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4620)] 03:42:15.787304 run osmo-stp_10.42.42.5(pid=4620): stdout: | (launched: 2022-12-14_03:42:14.405462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:15.920816 run osmo-stp_10.42.42.5(pid=4620): stderr: | [0;m[38;5;43m20221214034214578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034214578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034214579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034214579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:16.053388 run osmo-stp_10.42.42.5(pid=4620): stdout: | (launched: 2022-12-14_03:42:14.405462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:16.180038 run osmo-stp_10.42.42.5(pid=4620): stderr: | [0;m[38;5;43m20221214034214578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034214578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034214579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034214579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034214581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:16.331385 run patchelf(pid=4623): Terminating (SIGINT) 03:42:16.505176 run patchelf(pid=4623): Terminated: ok {rc=0} 03:42:16.630084 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4620): Process ended prematurely: osmo-stp_10.42.42.5(pid=4620) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4620)] [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 03:42:16.640515 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:42:16.669197 run osmo-hlr_10.42.42.2(pid=4617): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4617)] 03:42:16.718209 run osmo-hlr_10.42.42.2(pid=4617): stdout: | (launched: 2022-12-14_03:42:13.435761) 03:42:16.768757 run osmo-hlr_10.42.42.2(pid=4617): stderr: | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034213617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034213629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034213638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034213638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034213638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:16.820293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4606): Terminating (SIGTERM) 03:42:16.860596 run iperf3-srv_10.42.42.10(pid=4607): Terminating (SIGTERM) 03:42:16.900664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4608): Terminating (SIGTERM) 03:42:16.941167 run iperf3-srv_10.42.42.10(pid=4609): Terminating (SIGTERM) 03:42:16.982664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminating (SIGTERM) 03:42:17.023812 run iperf3-srv_10.42.42.10(pid=4611): Terminating (SIGTERM) 03:42:17.064297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminating (SIGTERM) 03:42:17.105357 run iperf3-srv_10.42.42.10(pid=4613): Terminating (SIGTERM) 03:42:17.147905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4616): Terminating (SIGTERM) 03:42:17.188837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4619): Terminating (SIGTERM) 03:42:17.231339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4622): Terminating (SIGTERM) 03:42:17.273863 --- ParallelTerminationStrategy: PID 4606 died... 03:42:17.293156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4606): Terminated: ok {rc=0} 03:42:17.337081 --- ParallelTerminationStrategy: PID 4607 died... 03:42:17.355486 run iperf3-srv_10.42.42.10(pid=4607): Terminated {rc=256} 03:42:17.398787 --- ParallelTerminationStrategy: PID 4608 died... 03:42:17.417203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4608): Terminated: ok {rc=0} 03:42:17.460243 --- ParallelTerminationStrategy: PID 4609 died... 03:42:17.478586 run iperf3-srv_10.42.42.10(pid=4609): Terminated {rc=256} 03:42:17.522012 --- ParallelTerminationStrategy: PID 4610 died... 03:42:17.540486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminated: ok {rc=0} 03:42:17.583655 --- ParallelTerminationStrategy: PID 4611 died... 03:42:17.602174 run iperf3-srv_10.42.42.10(pid=4611): Terminated {rc=256} 03:42:17.645426 --- ParallelTerminationStrategy: PID 4612 died... 03:42:17.663854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminated: ok {rc=0} 03:42:17.707043 --- ParallelTerminationStrategy: PID 4613 died... 03:42:17.725459 run iperf3-srv_10.42.42.10(pid=4613): Terminated {rc=256} 03:42:17.768568 --- ParallelTerminationStrategy: PID 4616 died... 03:42:17.787126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4616): Terminated: ok {rc=0} 03:42:17.830339 --- ParallelTerminationStrategy: PID 4619 died... 03:42:17.848569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4619): Terminated: ok {rc=0} 03:42:17.891917 --- ParallelTerminationStrategy: PID 4622 died... 03:42:17.910423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4622): Terminated: ok {rc=0} 03:42:17.993698 bus /gobi_4: Setting Powered False 03:42:19.091559 bus /gobi_4: Setting Powered False 03:42:20.208734 bus /gobi_1: Setting Powered False 03:42:21.306976 bus /gobi_1: Setting Powered False 03:42:22.422853 bus /gobi_0: Setting Powered False 03:42:23.517012 bus /gobi_0: Setting Powered False 03:42:24.631803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 03:42:25.735877 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:25.747976 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:25.786390 tst ping.py: using LAC 38302 03:42:25.914439 tst ping.py: using RAC 52 03:42:26.040340 tst ping.py: using CellId 38302 03:42:26.167406 tst ping.py: using BVCI 38303 03:42:26.284832 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.296552 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.307725 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.318823 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.330179 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.341629 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.353096 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:26.364487 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:26.482085 tst ping.py:19: start network... 03:42:26.683280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:27.152374 run create_hlr_db(pid=4624): Launched 03:42:27.275859 bus /gobi_6: Setting Powered False 03:42:28.335620 run create_hlr_db(pid=4624): Terminated: ok {rc=0} 03:42:28.758840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4626): Launched 03:42:29.060712 run osmo-hlr_10.42.42.2(pid=4627): Launched 03:42:29.174922 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:29.691682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4629): Launched 03:42:29.992789 run osmo-stp_10.42.42.5(pid=4630): Launched 03:42:30.107222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:30.630161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4632): Launched 03:42:30.745009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:31.021400 run patchelf(pid=4633): Launched 03:42:31.201718 run osmo-stp_10.42.42.5(pid=4630): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4630)] 03:42:31.332283 run osmo-stp_10.42.42.5(pid=4630): stdout: | (launched: 2022-12-14_03:42:29.935252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:31.464203 run osmo-stp_10.42.42.5(pid=4630): stderr: | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034230107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:31.596796 run osmo-stp_10.42.42.5(pid=4630): stdout: | (launched: 2022-12-14_03:42:29.935252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:31.723361 run osmo-stp_10.42.42.5(pid=4630): stderr: | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034230106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034230107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034230109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:31.872208 run patchelf(pid=4633): Terminating (SIGINT) 03:42:32.043431 run patchelf(pid=4633): Terminated: ok {rc=0} 03:42:32.167082 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4630): Process ended prematurely: osmo-stp_10.42.42.5(pid=4630) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4630)] [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 03:42:32.176527 tst ping.py:22: Test FAILED (6.4 sec) 03:42:32.204195 run osmo-hlr_10.42.42.2(pid=4627): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4627)] 03:42:32.253370 run osmo-hlr_10.42.42.2(pid=4627): stdout: | (launched: 2022-12-14_03:42:29.003204) 03:42:32.303276 run osmo-hlr_10.42.42.2(pid=4627): stderr: | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034229183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034229195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034229206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034229206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034229206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:32.353515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4626): Terminating (SIGTERM) 03:42:32.393356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4629): Terminating (SIGTERM) 03:42:32.433162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4632): Terminating (SIGTERM) 03:42:32.473534 --- ParallelTerminationStrategy: PID 4626 died... 03:42:32.492872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4626): Terminated: ok {rc=0} 03:42:32.537409 --- ParallelTerminationStrategy: PID 4629 died... 03:42:32.556212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4629): Terminated: ok {rc=0} 03:42:32.600313 --- ParallelTerminationStrategy: PID 4632 died... 03:42:32.619130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4632): Terminated: ok {rc=0} 03:42:32.704393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:42:33.793686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:33.805352 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:42:33.844579 tst ping_idle_ping.py: using LAC 38303 03:42:33.964487 tst ping_idle_ping.py: using RAC 53 03:42:34.084486 tst ping_idle_ping.py: using CellId 38303 03:42:34.213056 tst ping_idle_ping.py: using BVCI 38304 03:42:34.332220 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.343978 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.355406 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.366697 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.378539 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.390027 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.401840 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:42:34.413301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:42:34.545358 tst ping_idle_ping.py:24: start network... 03:42:34.746653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:35.216219 run create_hlr_db(pid=4634): Launched 03:42:35.341280 bus /gobi_6: Setting Powered False 03:42:36.401699 run create_hlr_db(pid=4634): Terminated: ok {rc=0} 03:42:36.844475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Launched 03:42:37.169646 run osmo-hlr_10.42.42.2(pid=4637): Launched 03:42:37.293880 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:37.855475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Launched 03:42:38.162735 run osmo-stp_10.42.42.5(pid=4640): Launched 03:42:38.276110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:38.797752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Launched 03:42:38.912376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:39.168258 run patchelf(pid=4643): Launched 03:42:39.334846 run osmo-stp_10.42.42.5(pid=4640): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] 03:42:39.461724 run osmo-stp_10.42.42.5(pid=4640): stdout: | (launched: 2022-12-14_03:42:38.105262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:39.590609 run osmo-stp_10.42.42.5(pid=4640): stderr: | [0;m[38;5;43m20221214034238278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034238278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034238279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034238279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:39.720164 run osmo-stp_10.42.42.5(pid=4640): stdout: | (launched: 2022-12-14_03:42:38.105262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:39.843137 run osmo-stp_10.42.42.5(pid=4640): stderr: | [0;m[38;5;43m20221214034238278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034238278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034238279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034238279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034238280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:39.989104 run patchelf(pid=4643): Terminating (SIGINT) 03:42:40.157748 run patchelf(pid=4643): Terminated: ok {rc=0} 03:42:40.278800 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4640): Process ended prematurely: osmo-stp_10.42.42.5(pid=4640) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 03:42:40.287622 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:42:40.314061 run osmo-hlr_10.42.42.2(pid=4637): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4637)] 03:42:40.361409 run osmo-hlr_10.42.42.2(pid=4637): stdout: | (launched: 2022-12-14_03:42:37.108504) 03:42:40.410593 run osmo-hlr_10.42.42.2(pid=4637): stderr: | [0;m[1;31m20221214034237310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034237310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034237311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034237311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034237311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034237311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034237343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034237351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034237352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034237352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:40.460723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Terminating (SIGTERM) 03:42:40.500019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Terminating (SIGTERM) 03:42:40.539151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Terminating (SIGTERM) 03:42:40.578697 --- ParallelTerminationStrategy: PID 4636 died... 03:42:40.597738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4636): Terminated: ok {rc=0} 03:42:40.641305 --- ParallelTerminationStrategy: PID 4639 died... 03:42:40.659579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4639): Terminated: ok {rc=0} 03:42:40.702882 --- ParallelTerminationStrategy: PID 4642 died... 03:42:40.721312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4642): Terminated: ok {rc=0} 03:42:40.804200 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:42:42.093622 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:42:42.100196 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:42:42.121607 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:42:42.162331 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:42:42.253742 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:42:42.275852 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:42:42.316262 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:42:42.907631 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:42:42.961625 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:42.973076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:42:43.030946 tst cs_paging_gprs_active.py: using LAC 38304 03:42:43.159560 tst cs_paging_gprs_active.py: using RAC 54 03:42:43.289934 tst cs_paging_gprs_active.py: using CellId 38304 03:42:43.411805 tst cs_paging_gprs_active.py: using BVCI 38305 03:42:43.522855 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.533765 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.544258 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.554834 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.565922 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.577081 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.588257 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.599257 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:43.610495 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:43.731966 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:43.850794 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:42:44.055773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:44.364433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4647): Launched 03:42:44.633899 run iperf3-srv_10.42.42.10(pid=4648): Launched 03:42:44.748601 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:42:44.953248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:45.261816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4649): Launched 03:42:45.529977 run iperf3-srv_10.42.42.10(pid=4650): Launched 03:42:45.646090 tst cs_paging_gprs_active.py:38: start network... 03:42:45.851788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:46.341760 run create_hlr_db(pid=4651): Launched 03:42:46.503141 bus /gobi_6: Setting Powered False 03:42:47.569034 run create_hlr_db(pid=4651): Terminated: ok {rc=0} 03:42:48.009615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4653): Launched 03:42:48.318260 run osmo-hlr_10.42.42.2(pid=4654): Launched 03:42:48.434652 run osmo-stp_10.42.42.5: Starting osmo-stp 03:42:48.971229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4656): Launched 03:42:49.279773 run osmo-stp_10.42.42.5(pid=4657): Launched 03:42:49.396389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:42:49.929588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4659): Launched 03:42:50.047183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:42:50.308670 run patchelf(pid=4660): Launched 03:42:50.478892 run osmo-stp_10.42.42.5(pid=4657): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4657)] 03:42:50.608418 run osmo-stp_10.42.42.5(pid=4657): stdout: | (launched: 2022-12-14_03:42:49.220833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:50.740099 run osmo-stp_10.42.42.5(pid=4657): stderr: | [0;m[38;5;43m20221214034249395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034249396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034249396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034249396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:50.871699 run osmo-stp_10.42.42.5(pid=4657): stdout: | (launched: 2022-12-14_03:42:49.220833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:42:50.997083 run osmo-stp_10.42.42.5(pid=4657): stderr: | [0;m[38;5;43m20221214034249395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034249396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034249396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034249396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034249397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:42:51.146144 run patchelf(pid=4660): Terminating (SIGINT) 03:42:51.317364 run patchelf(pid=4660): Terminated: ok {rc=0} 03:42:51.440754 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4657): Process ended prematurely: osmo-stp_10.42.42.5(pid=4657) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4657)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:42:51.450242 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:42:51.477464 run osmo-hlr_10.42.42.2(pid=4654): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4654)] 03:42:51.524896 run osmo-hlr_10.42.42.2(pid=4654): stdout: | (launched: 2022-12-14_03:42:48.259603) 03:42:51.574381 run osmo-hlr_10.42.42.2(pid=4654): stderr: | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034248439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034248451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034248460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034248460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034248461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:42:51.624234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4647): Terminating (SIGTERM) 03:42:51.663930 run iperf3-srv_10.42.42.10(pid=4648): Terminating (SIGTERM) 03:42:51.703516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4649): Terminating (SIGTERM) 03:42:51.743269 run iperf3-srv_10.42.42.10(pid=4650): Terminating (SIGTERM) 03:42:51.782775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4653): Terminating (SIGTERM) 03:42:51.823053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4656): Terminating (SIGTERM) 03:42:51.862619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4659): Terminating (SIGTERM) 03:42:51.902320 --- ParallelTerminationStrategy: PID 4647 died... 03:42:51.921419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4647): Terminated: ok {rc=0} 03:42:51.965323 --- ParallelTerminationStrategy: PID 4648 died... 03:42:51.983788 run iperf3-srv_10.42.42.10(pid=4648): Terminated {rc=256} 03:42:52.027188 --- ParallelTerminationStrategy: PID 4649 died... 03:42:52.045965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4649): Terminated: ok {rc=0} 03:42:52.090117 --- ParallelTerminationStrategy: PID 4650 died... 03:42:52.108565 run iperf3-srv_10.42.42.10(pid=4650): Terminated {rc=256} 03:42:52.152184 --- ParallelTerminationStrategy: PID 4653 died... 03:42:52.170925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4653): Terminated: ok {rc=0} 03:42:52.214463 --- ParallelTerminationStrategy: PID 4656 died... 03:42:52.233109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4656): Terminated: ok {rc=0} 03:42:52.276797 --- ParallelTerminationStrategy: PID 4659 died... 03:42:52.295901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4659): Terminated: ok {rc=0} 03:42:52.382029 bus /gobi_0: Setting Powered False 03:42:53.481135 bus /gobi_0: Setting Powered False 03:42:54.596545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:42:55.748164 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:55.760262 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:42:55.819872 tst iperf3.py: using LAC 38305 03:42:55.943054 tst iperf3.py: using RAC 55 03:42:56.065113 tst iperf3.py: using CellId 38305 03:42:56.187038 tst iperf3.py: using BVCI 38306 03:42:56.299901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.311068 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.321873 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.332551 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.343636 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.354729 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.366072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.377272 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:42:56.389152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:42:56.510250 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:42:56.732930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:42:57.065631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4661): Launched 03:42:57.355415 run iperf3-srv_10.42.42.10(pid=4662): Launched 03:42:57.479725 tst iperf3.py:8: start network... 03:42:57.701610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:42:58.215263 run create_hlr_db(pid=4663): Launched 03:42:58.341946 bus /gobi_6: Setting Powered False 03:42:59.406351 run create_hlr_db(pid=4663): Terminated: ok {rc=0} 03:42:59.845541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Launched 03:43:00.155909 run osmo-hlr_10.42.42.2(pid=4666): Launched 03:43:00.272652 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:00.818547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Launched 03:43:01.147882 run osmo-stp_10.42.42.5(pid=4669): Launched 03:43:01.388891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:02.017243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4671): Launched 03:43:02.151254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:02.414787 run patchelf(pid=4672): Launched 03:43:02.584683 run osmo-stp_10.42.42.5(pid=4669): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] 03:43:02.714053 run osmo-stp_10.42.42.5(pid=4669): stdout: | (launched: 2022-12-14_03:43:01.084140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:02.845227 run osmo-stp_10.42.42.5(pid=4669): stderr: | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034301391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:02.975930 run osmo-stp_10.42.42.5(pid=4669): stdout: | (launched: 2022-12-14_03:43:01.084140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:03.101563 run osmo-stp_10.42.42.5(pid=4669): stderr: | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034301390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034301391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034301393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:03.250067 run patchelf(pid=4672): Terminating (SIGINT) 03:43:03.420674 run patchelf(pid=4672): Terminated: ok {rc=0} 03:43:03.543606 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4669): Process ended prematurely: osmo-stp_10.42.42.5(pid=4669) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 03:43:03.553255 tst iperf3.py:8: Test FAILED (7.8 sec) 03:43:03.580522 run osmo-hlr_10.42.42.2(pid=4666): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4666)] 03:43:03.628422 run osmo-hlr_10.42.42.2(pid=4666): stdout: | (launched: 2022-12-14_03:43:00.097115) 03:43:03.677893 run osmo-hlr_10.42.42.2(pid=4666): stderr: | [0;m[1;31m20221214034300274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034300274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034300274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034300274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034300275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034300275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034300289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034300298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034300298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034300298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:03.727751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4661): Terminating (SIGTERM) 03:43:03.767830 run iperf3-srv_10.42.42.10(pid=4662): Terminating (SIGTERM) 03:43:03.807453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Terminating (SIGTERM) 03:43:03.847300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Terminating (SIGTERM) 03:43:03.887404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4671): Terminating (SIGTERM) 03:43:03.927574 --- ParallelTerminationStrategy: PID 4661 died... 03:43:03.946935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4661): Terminated: ok {rc=0} 03:43:03.991060 --- ParallelTerminationStrategy: PID 4662 died... 03:43:04.009799 run iperf3-srv_10.42.42.10(pid=4662): Terminated {rc=256} 03:43:04.053414 --- ParallelTerminationStrategy: PID 4665 died... 03:43:04.072122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4665): Terminated: ok {rc=0} 03:43:04.116125 --- ParallelTerminationStrategy: PID 4668 died... 03:43:04.134914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4668): Terminated: ok {rc=0} 03:43:04.178886 --- ParallelTerminationStrategy: PID 4671 died... 03:43:04.197826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4671): Terminated: ok {rc=0} 03:43:04.283871 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:43:05.433247 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.444643 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:05.502050 tst iperf3m4.py: using LAC 38306 03:43:05.623296 tst iperf3m4.py: using RAC 56 03:43:05.748068 tst iperf3m4.py: using CellId 38306 03:43:05.867839 tst iperf3m4.py: using BVCI 38307 03:43:05.979408 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:05.990428 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.001214 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.011860 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.022550 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.033560 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.044374 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.055030 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:06.065941 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:06.187136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:06.311901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:06.433794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:06.550811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:06.756456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:07.067505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4673): Launched 03:43:07.337132 run iperf3-srv_10.42.42.10(pid=4674): Launched 03:43:07.452482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:43:07.656934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:07.967130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4675): Launched 03:43:08.236319 run iperf3-srv_10.42.42.10(pid=4676): Launched 03:43:08.351417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:43:08.555231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:08.864392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4677): Launched 03:43:09.133463 run iperf3-srv_10.42.42.10(pid=4678): Launched 03:43:09.248873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:43:09.453698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:09.764087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4679): Launched 03:43:10.033247 run iperf3-srv_10.42.42.10(pid=4680): Launched 03:43:10.148170 tst iperf3m4.py:8: start network... 03:43:10.352111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:10.830488 run create_hlr_db(pid=4681): Launched 03:43:10.955852 bus /gobi_6: Setting Powered False 03:43:12.020177 run create_hlr_db(pid=4681): Terminated: ok {rc=0} 03:43:12.479793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4683): Launched 03:43:12.810395 run osmo-hlr_10.42.42.2(pid=4684): Launched 03:43:12.935953 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:13.505779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4686): Launched 03:43:13.835621 run osmo-stp_10.42.42.5(pid=4687): Launched 03:43:13.960473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:14.529450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4689): Launched 03:43:14.654828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:14.935827 run patchelf(pid=4690): Launched 03:43:15.118926 run osmo-stp_10.42.42.5(pid=4687): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4687)] 03:43:15.257691 run osmo-stp_10.42.42.5(pid=4687): stdout: | (launched: 2022-12-14_03:43:13.773478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:15.398671 run osmo-stp_10.42.42.5(pid=4687): stderr: | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034313972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:15.538885 run osmo-stp_10.42.42.5(pid=4687): stdout: | (launched: 2022-12-14_03:43:13.773478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:15.673219 run osmo-stp_10.42.42.5(pid=4687): stderr: | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034313971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034313972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034313972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:15.842588 run patchelf(pid=4690): Terminating (SIGINT) 03:43:16.041784 run patchelf(pid=4690): Terminated: ok {rc=0} 03:43:16.176762 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4687): Process ended prematurely: osmo-stp_10.42.42.5(pid=4687) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4687)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:43:16.188008 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:43:16.218149 run osmo-hlr_10.42.42.2(pid=4684): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4684)] 03:43:16.272902 run osmo-hlr_10.42.42.2(pid=4684): stdout: | (launched: 2022-12-14_03:43:12.748159) 03:43:16.327103 run osmo-hlr_10.42.42.2(pid=4684): stderr: | [0;m[1;31m20221214034312951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034312951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034312951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034312952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034312952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034312952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034312967 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034312977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034312977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034312977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:16.381828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4673): Terminating (SIGTERM) 03:43:16.425241 run iperf3-srv_10.42.42.10(pid=4674): Terminating (SIGTERM) 03:43:16.471592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4675): Terminating (SIGTERM) 03:43:16.516162 run iperf3-srv_10.42.42.10(pid=4676): Terminating (SIGTERM) 03:43:16.562914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4677): Terminating (SIGTERM) 03:43:16.607676 run iperf3-srv_10.42.42.10(pid=4678): Terminating (SIGTERM) 03:43:16.654491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4679): Terminating (SIGTERM) 03:43:16.699309 run iperf3-srv_10.42.42.10(pid=4680): Terminating (SIGTERM) 03:43:16.746352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4683): Terminating (SIGTERM) 03:43:16.790889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4686): Terminating (SIGTERM) 03:43:16.835190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4689): Terminating (SIGTERM) 03:43:16.879786 --- ParallelTerminationStrategy: PID 4673 died... 03:43:16.901708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4673): Terminated: ok {rc=0} 03:43:16.950667 --- ParallelTerminationStrategy: PID 4674 died... 03:43:16.972058 run iperf3-srv_10.42.42.10(pid=4674): Terminated {rc=256} 03:43:17.020611 --- ParallelTerminationStrategy: PID 4675 died... 03:43:17.042290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4675): Terminated: ok {rc=0} 03:43:17.090839 --- ParallelTerminationStrategy: PID 4676 died... 03:43:17.112355 run iperf3-srv_10.42.42.10(pid=4676): Terminated {rc=256} 03:43:17.160582 --- ParallelTerminationStrategy: PID 4677 died... 03:43:17.182360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4677): Terminated: ok {rc=0} 03:43:17.231482 --- ParallelTerminationStrategy: PID 4678 died... 03:43:17.251660 run iperf3-srv_10.42.42.10(pid=4678): Terminated {rc=256} 03:43:17.298306 --- ParallelTerminationStrategy: PID 4679 died... 03:43:17.318765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4679): Terminated: ok {rc=0} 03:43:17.365799 --- ParallelTerminationStrategy: PID 4680 died... 03:43:17.385916 run iperf3-srv_10.42.42.10(pid=4680): Terminated {rc=256} 03:43:17.432548 --- ParallelTerminationStrategy: PID 4683 died... 03:43:17.452834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4683): Terminated: ok {rc=0} 03:43:17.499996 --- ParallelTerminationStrategy: PID 4686 died... 03:43:17.520097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4686): Terminated: ok {rc=0} 03:43:17.567106 --- ParallelTerminationStrategy: PID 4689 died... 03:43:17.587212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4689): Terminated: ok {rc=0} 03:43:17.676762 bus /gobi_4: Setting Powered False 03:43:18.775835 bus /gobi_4: Setting Powered False 03:43:19.892157 bus /gobi_1: Setting Powered False 03:43:20.990467 bus /gobi_1: Setting Powered False 03:43:22.106260 bus /gobi_0: Setting Powered False 03:43:23.204235 bus /gobi_0: Setting Powered False 03:43:24.322443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:43:25.425890 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:25.438032 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:25.496701 tst ping.py: using LAC 38307 03:43:25.616624 tst ping.py: using RAC 57 03:43:25.734313 tst ping.py: using CellId 38307 03:43:25.852671 tst ping.py: using BVCI 38308 03:43:25.963319 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:25.974472 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:25.985394 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:25.996020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:26.006571 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:26.017056 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:26.027787 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:26.039052 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:26.158290 tst ping.py:19: start network... 03:43:26.376368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:26.880010 run create_hlr_db(pid=4691): Launched 03:43:27.003080 bus /gobi_6: Setting Powered False 03:43:28.067296 run create_hlr_db(pid=4691): Terminated: ok {rc=0} 03:43:28.501580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Launched 03:43:28.804767 run osmo-hlr_10.42.42.2(pid=4694): Launched 03:43:28.919006 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:29.463543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Launched 03:43:29.764646 run osmo-stp_10.42.42.5(pid=4697): Launched 03:43:29.878706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:30.399673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Launched 03:43:30.514214 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:30.769691 run patchelf(pid=4700): Launched 03:43:30.963440 run osmo-stp_10.42.42.5(pid=4697): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] 03:43:31.101832 run osmo-stp_10.42.42.5(pid=4697): stdout: | (launched: 2022-12-14_03:43:29.707333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:31.244722 run osmo-stp_10.42.42.5(pid=4697): stderr: | [0;m[38;5;43m20221214034329881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034329881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034329882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:31.389886 run osmo-stp_10.42.42.5(pid=4697): stdout: | (launched: 2022-12-14_03:43:29.707333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:31.528174 run osmo-stp_10.42.42.5(pid=4697): stderr: | [0;m[38;5;43m20221214034329881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034329881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034329882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034329882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034329882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:31.690837 run patchelf(pid=4700): Terminating (SIGINT) 03:43:31.876074 run patchelf(pid=4700): Terminated: ok {rc=0} 03:43:32.011545 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4697): Process ended prematurely: osmo-stp_10.42.42.5(pid=4697) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 03:43:32.022295 tst ping.py:22: Test FAILED (6.6 sec) 03:43:32.051660 run osmo-hlr_10.42.42.2(pid=4694): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4694)] 03:43:32.107830 run osmo-hlr_10.42.42.2(pid=4694): stdout: | (launched: 2022-12-14_03:43:28.747044) 03:43:32.163041 run osmo-hlr_10.42.42.2(pid=4694): stderr: | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034328926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034328938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034328949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034328949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034328949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:32.216370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Terminating (SIGTERM) 03:43:32.258720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Terminating (SIGTERM) 03:43:32.301539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminating (SIGTERM) 03:43:32.344921 --- ParallelTerminationStrategy: PID 4693 died... 03:43:32.365920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4693): Terminated: ok {rc=0} 03:43:32.412931 --- ParallelTerminationStrategy: PID 4696 died... 03:43:32.433290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4696): Terminated: ok {rc=0} 03:43:32.480184 --- ParallelTerminationStrategy: PID 4699 died... 03:43:32.500568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4699): Terminated: ok {rc=0} 03:43:32.590283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:43:33.677295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:33.689320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:43:33.747575 tst ping_idle_ping.py: using LAC 38308 03:43:33.866309 tst ping_idle_ping.py: using RAC 58 03:43:33.985876 tst ping_idle_ping.py: using CellId 38308 03:43:34.103282 tst ping_idle_ping.py: using BVCI 38309 03:43:34.223307 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.234854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.246271 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.257524 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.268860 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.281358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.292810 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:43:34.304266 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:43:34.419538 tst ping_idle_ping.py:24: start network... 03:43:34.620350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:35.089639 run create_hlr_db(pid=4701): Launched 03:43:35.214283 bus /gobi_6: Setting Powered False 03:43:36.274492 run create_hlr_db(pid=4701): Terminated: ok {rc=0} 03:43:36.718463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Launched 03:43:37.045543 run osmo-hlr_10.42.42.2(pid=4704): Launched 03:43:37.170551 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:37.733917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Launched 03:43:38.059760 run osmo-stp_10.42.42.5(pid=4707): Launched 03:43:38.183205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:38.743806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Launched 03:43:38.867598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:39.143834 run patchelf(pid=4710): Launched 03:43:39.324317 run osmo-stp_10.42.42.5(pid=4707): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] 03:43:39.461933 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-14_03:43:37.998149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:39.601100 run osmo-stp_10.42.42.5(pid=4707): stderr: | [0;m[38;5;43m20221214034338194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034338194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034338195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034338195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:39.740298 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-14_03:43:37.998149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:39.873489 run osmo-stp_10.42.42.5(pid=4707): stderr: | [0;m[38;5;43m20221214034338194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034338194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034338195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034338195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034338196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:40.032019 run patchelf(pid=4710): Terminating (SIGINT) 03:43:40.213475 run patchelf(pid=4710): Terminated: ok {rc=0} 03:43:40.344383 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:43:40.354090 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:43:40.382194 run osmo-hlr_10.42.42.2(pid=4704): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4704)] 03:43:40.433374 run osmo-hlr_10.42.42.2(pid=4704): stdout: | (launched: 2022-12-14_03:43:36.983994) 03:43:40.485485 run osmo-hlr_10.42.42.2(pid=4704): stderr: | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034337185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034337198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034337206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034337206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034337206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:40.538180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminating (SIGTERM) 03:43:40.579735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminating (SIGTERM) 03:43:40.622488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminating (SIGTERM) 03:43:40.665124 --- ParallelTerminationStrategy: PID 4703 died... 03:43:40.685530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminated: ok {rc=0} 03:43:40.732244 --- ParallelTerminationStrategy: PID 4706 died... 03:43:40.752214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminated: ok {rc=0} 03:43:40.798859 --- ParallelTerminationStrategy: PID 4709 died... 03:43:40.818863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminated: ok {rc=0} 03:43:40.907282 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:43:42.197699 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:43:42.203663 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:43:42.224214 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:43:42.262559 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:43:42.348700 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:43:42.369496 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:43:42.407526 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:43:42.999810 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:43:43.048442 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.059281 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:43:43.116588 tst cs_paging_gprs_active.py: using LAC 38309 03:43:43.237283 tst cs_paging_gprs_active.py: using RAC 59 03:43:43.357019 tst cs_paging_gprs_active.py: using CellId 38309 03:43:43.478218 tst cs_paging_gprs_active.py: using BVCI 38310 03:43:43.590549 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.601444 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.612030 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.622770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.633369 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.643925 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.654692 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.665220 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:43.676400 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:43.797493 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:43.919063 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:43:44.142101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:44.475988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4715): Launched 03:43:44.764533 run iperf3-srv_10.42.42.10(pid=4716): Launched 03:43:44.887973 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:43:45.110048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:45.443129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4717): Launched 03:43:45.731151 run iperf3-srv_10.42.42.10(pid=4718): Launched 03:43:45.864068 tst cs_paging_gprs_active.py:38: start network... 03:43:46.088216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:46.584658 run create_hlr_db(pid=4719): Launched 03:43:46.742561 bus /gobi_6: Setting Powered False 03:43:47.803970 run create_hlr_db(pid=4719): Terminated: ok {rc=0} 03:43:48.253479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4721): Launched 03:43:48.585125 run osmo-hlr_10.42.42.2(pid=4722): Launched 03:43:48.710553 run osmo-stp_10.42.42.5: Starting osmo-stp 03:43:49.280818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4724): Launched 03:43:49.589864 run osmo-stp_10.42.42.5(pid=4725): Launched 03:43:49.705410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:43:50.237100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4727): Launched 03:43:50.355152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:43:50.616057 run patchelf(pid=4728): Launched 03:43:50.786179 run osmo-stp_10.42.42.5(pid=4725): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4725)] 03:43:50.915771 run osmo-stp_10.42.42.5(pid=4725): stdout: | (launched: 2022-12-14_03:43:49.531316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:51.046995 run osmo-stp_10.42.42.5(pid=4725): stderr: | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034349706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:51.178196 run osmo-stp_10.42.42.5(pid=4725): stdout: | (launched: 2022-12-14_03:43:49.531316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:43:51.303537 run osmo-stp_10.42.42.5(pid=4725): stderr: | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034349706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034349706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034349707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:43:51.451879 run patchelf(pid=4728): Terminating (SIGINT) 03:43:51.622945 run patchelf(pid=4728): Terminated: ok {rc=0} 03:43:51.746007 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4725): Process ended prematurely: osmo-stp_10.42.42.5(pid=4725) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4725)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:43:51.755451 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:43:51.782683 run osmo-hlr_10.42.42.2(pid=4722): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4722)] 03:43:51.830127 run osmo-hlr_10.42.42.2(pid=4722): stdout: | (launched: 2022-12-14_03:43:48.523076) 03:43:51.879275 run osmo-hlr_10.42.42.2(pid=4722): stderr: | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034348725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034348738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034348746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034348746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034348746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:43:51.929075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4715): Terminating (SIGTERM) 03:43:51.968443 run iperf3-srv_10.42.42.10(pid=4716): Terminating (SIGTERM) 03:43:52.007678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4717): Terminating (SIGTERM) 03:43:52.047131 run iperf3-srv_10.42.42.10(pid=4718): Terminating (SIGTERM) 03:43:52.086217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4721): Terminating (SIGTERM) 03:43:52.125431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4724): Terminating (SIGTERM) 03:43:52.164643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4727): Terminating (SIGTERM) 03:43:52.204071 --- ParallelTerminationStrategy: PID 4715 died... 03:43:52.223263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4715): Terminated: ok {rc=0} 03:43:52.267484 --- ParallelTerminationStrategy: PID 4716 died... 03:43:52.286240 run iperf3-srv_10.42.42.10(pid=4716): Terminated {rc=256} 03:43:52.329783 --- ParallelTerminationStrategy: PID 4717 died... 03:43:52.348284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4717): Terminated: ok {rc=0} 03:43:52.391899 --- ParallelTerminationStrategy: PID 4718 died... 03:43:52.410299 run iperf3-srv_10.42.42.10(pid=4718): Terminated {rc=256} 03:43:52.453650 --- ParallelTerminationStrategy: PID 4721 died... 03:43:52.472013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4721): Terminated: ok {rc=0} 03:43:52.515426 --- ParallelTerminationStrategy: PID 4724 died... 03:43:52.534026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4724): Terminated: ok {rc=0} 03:43:52.577423 --- ParallelTerminationStrategy: PID 4727 died... 03:43:52.596035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4727): Terminated: ok {rc=0} 03:43:52.678716 bus /gobi_0: Setting Powered False 03:43:53.777055 bus /gobi_0: Setting Powered False 03:43:54.895819 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:43:56.041572 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.053222 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:43:56.113815 tst iperf3.py: using LAC 38310 03:43:56.234846 tst iperf3.py: using RAC 60 03:43:56.365893 tst iperf3.py: using CellId 38310 03:43:56.494438 tst iperf3.py: using BVCI 38311 03:43:56.615752 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.627397 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.638788 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.649919 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.661234 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.672568 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.684036 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.695389 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:43:56.706850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:43:56.827044 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:43:57.033835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:43:57.344169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Launched 03:43:57.614455 run iperf3-srv_10.42.42.10(pid=4730): Launched 03:43:57.729914 tst iperf3.py:8: start network... 03:43:57.934820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:43:58.413526 run create_hlr_db(pid=4731): Launched 03:43:58.540153 bus /gobi_6: Setting Powered False 03:43:59.601779 run create_hlr_db(pid=4731): Terminated: ok {rc=0} 03:44:00.051976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Launched 03:44:00.384814 run osmo-hlr_10.42.42.2(pid=4734): Launched 03:44:00.511210 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:01.114128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Launched 03:44:01.462441 run osmo-stp_10.42.42.5(pid=4737): Launched 03:44:01.658148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:02.379300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Launched 03:44:02.497429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:02.758705 run patchelf(pid=4740): Launched 03:44:02.928865 run osmo-stp_10.42.42.5(pid=4737): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] 03:44:03.058343 run osmo-stp_10.42.42.5(pid=4737): stdout: | (launched: 2022-12-14_03:44:01.397793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:03.189275 run osmo-stp_10.42.42.5(pid=4737): stderr: | [0;m[38;5;43m20221214034401767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034401767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034401768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034401769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034401769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034401769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034401770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:03.320554 run osmo-stp_10.42.42.5(pid=4737): stdout: | (launched: 2022-12-14_03:44:01.397793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:03.446380 run osmo-stp_10.42.42.5(pid=4737): stderr: | [0;m[38;5;43m20221214034401767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034401767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034401768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034401769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034401769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034401769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034401770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:03.595194 run patchelf(pid=4740): Terminating (SIGINT) 03:44:03.766318 run patchelf(pid=4740): Terminated: ok {rc=0} 03:44:03.889578 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4737): Process ended prematurely: osmo-stp_10.42.42.5(pid=4737) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 03:44:03.899133 tst iperf3.py:8: Test FAILED (7.9 sec) 03:44:03.926384 run osmo-hlr_10.42.42.2(pid=4734): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4734)] 03:44:03.973866 run osmo-hlr_10.42.42.2(pid=4734): stdout: | (launched: 2022-12-14_03:44:00.321996) 03:44:04.023300 run osmo-hlr_10.42.42.2(pid=4734): stderr: | [0;m[1;31m20221214034400522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034400522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034400522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034400522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034400522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034400523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034400534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034400543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034400543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034400544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:04.073363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Terminating (SIGTERM) 03:44:04.113202 run iperf3-srv_10.42.42.10(pid=4730): Terminating (SIGTERM) 03:44:04.153041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Terminating (SIGTERM) 03:44:04.192697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Terminating (SIGTERM) 03:44:04.232255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Terminating (SIGTERM) 03:44:04.272168 --- ParallelTerminationStrategy: PID 4729 died... 03:44:04.291432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Terminated: ok {rc=0} 03:44:04.335660 --- ParallelTerminationStrategy: PID 4730 died... 03:44:04.354442 run iperf3-srv_10.42.42.10(pid=4730): Terminated {rc=256} 03:44:04.399384 --- ParallelTerminationStrategy: PID 4733 died... 03:44:04.418281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Terminated: ok {rc=0} 03:44:04.462327 --- ParallelTerminationStrategy: PID 4736 died... 03:44:04.481066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Terminated: ok {rc=0} 03:44:04.525174 --- ParallelTerminationStrategy: PID 4739 died... 03:44:04.543803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Terminated: ok {rc=0} 03:44:04.629315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:44:05.778406 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:05.790093 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:05.847046 tst iperf3m4.py: using LAC 38311 03:44:05.968556 tst iperf3m4.py: using RAC 61 03:44:06.088054 tst iperf3m4.py: using CellId 38311 03:44:06.209414 tst iperf3m4.py: using BVCI 38312 03:44:06.320050 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.331048 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.341744 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.352448 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.362988 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.373615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.384731 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.395555 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:06.406419 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:06.527488 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:06.647746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:06.768777 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:06.893328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:44:07.098505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:07.408127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4741): Launched 03:44:07.677631 run iperf3-srv_10.42.42.10(pid=4742): Launched 03:44:07.792928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:44:07.997565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:08.307796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4743): Launched 03:44:08.576649 run iperf3-srv_10.42.42.10(pid=4744): Launched 03:44:08.691483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:44:08.895004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:09.203807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4745): Launched 03:44:09.472239 run iperf3-srv_10.42.42.10(pid=4746): Launched 03:44:09.587297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:44:09.791192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:44:10.100415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4747): Launched 03:44:10.368418 run iperf3-srv_10.42.42.10(pid=4748): Launched 03:44:10.484245 tst iperf3m4.py:8: start network... 03:44:10.688109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:11.165814 run create_hlr_db(pid=4749): Launched 03:44:11.290723 bus /gobi_6: Setting Powered False 03:44:12.351927 run create_hlr_db(pid=4749): Terminated: ok {rc=0} 03:44:12.802608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4751): Launched 03:44:13.134767 run osmo-hlr_10.42.42.2(pid=4752): Launched 03:44:13.262964 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:13.840488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4754): Launched 03:44:14.172312 run osmo-stp_10.42.42.5(pid=4755): Launched 03:44:14.297659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:14.871106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4757): Launched 03:44:14.998212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:15.280026 run patchelf(pid=4758): Launched 03:44:15.464517 run osmo-stp_10.42.42.5(pid=4755): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4755)] 03:44:15.604174 run osmo-stp_10.42.42.5(pid=4755): stdout: | (launched: 2022-12-14_03:44:14.110015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:15.744936 run osmo-stp_10.42.42.5(pid=4755): stderr: | [0;m[38;5;43m20221214034414306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034414306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034414307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034414307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034414307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034414308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034414308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:15.915962 run osmo-stp_10.42.42.5(pid=4755): stdout: | (launched: 2022-12-14_03:44:14.110015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:16.056772 run osmo-stp_10.42.42.5(pid=4755): stderr: | [0;m[38;5;43m20221214034414306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034414306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034414307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034414307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034414307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034414308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034414308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:16.221016 run patchelf(pid=4758): Terminating (SIGINT) 03:44:16.410071 run patchelf(pid=4758): Terminated: ok {rc=0} 03:44:16.546589 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4755): Process ended prematurely: osmo-stp_10.42.42.5(pid=4755) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4755)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:44:16.558020 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:44:16.589826 run osmo-hlr_10.42.42.2(pid=4752): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4752)] 03:44:16.644150 run osmo-hlr_10.42.42.2(pid=4752): stdout: | (launched: 2022-12-14_03:44:13.071641) 03:44:16.699099 run osmo-hlr_10.42.42.2(pid=4752): stderr: | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034413273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034413287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034413296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034413297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034413297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:16.754709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4741): Terminating (SIGTERM) 03:44:16.798552 run iperf3-srv_10.42.42.10(pid=4742): Terminating (SIGTERM) 03:44:16.846205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4743): Terminating (SIGTERM) 03:44:16.891670 run iperf3-srv_10.42.42.10(pid=4744): Terminating (SIGTERM) 03:44:16.939181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4745): Terminating (SIGTERM) 03:44:16.984636 run iperf3-srv_10.42.42.10(pid=4746): Terminating (SIGTERM) 03:44:17.032233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4747): Terminating (SIGTERM) 03:44:17.077592 run iperf3-srv_10.42.42.10(pid=4748): Terminating (SIGTERM) 03:44:17.125236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4751): Terminating (SIGTERM) 03:44:17.170275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4754): Terminating (SIGTERM) 03:44:17.213299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4757): Terminating (SIGTERM) 03:44:17.256502 --- ParallelTerminationStrategy: PID 4741 died... 03:44:17.277710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4741): Terminated: ok {rc=0} 03:44:17.325281 --- ParallelTerminationStrategy: PID 4742 died... 03:44:17.345950 run iperf3-srv_10.42.42.10(pid=4742): Terminated {rc=256} 03:44:17.393296 --- ParallelTerminationStrategy: PID 4743 died... 03:44:17.413771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4743): Terminated: ok {rc=0} 03:44:17.461261 --- ParallelTerminationStrategy: PID 4744 died... 03:44:17.481811 run iperf3-srv_10.42.42.10(pid=4744): Terminated {rc=256} 03:44:17.528909 --- ParallelTerminationStrategy: PID 4745 died... 03:44:17.549849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4745): Terminated: ok {rc=0} 03:44:17.597637 --- ParallelTerminationStrategy: PID 4746 died... 03:44:17.618078 run iperf3-srv_10.42.42.10(pid=4746): Terminated {rc=256} 03:44:17.665368 --- ParallelTerminationStrategy: PID 4747 died... 03:44:17.685893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4747): Terminated: ok {rc=0} 03:44:17.733400 --- ParallelTerminationStrategy: PID 4748 died... 03:44:17.754033 run iperf3-srv_10.42.42.10(pid=4748): Terminated {rc=256} 03:44:17.801320 --- ParallelTerminationStrategy: PID 4751 died... 03:44:17.822001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4751): Terminated: ok {rc=0} 03:44:17.869345 --- ParallelTerminationStrategy: PID 4754 died... 03:44:17.889961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4754): Terminated: ok {rc=0} 03:44:17.937370 --- ParallelTerminationStrategy: PID 4757 died... 03:44:17.957928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4757): Terminated: ok {rc=0} 03:44:18.049040 bus /gobi_4: Setting Powered False 03:44:19.148288 bus /gobi_4: Setting Powered False 03:44:20.265644 bus /gobi_1: Setting Powered False 03:44:21.364648 bus /gobi_1: Setting Powered False 03:44:22.482597 bus /gobi_0: Setting Powered False 03:44:23.582147 bus /gobi_0: Setting Powered False 03:44:24.699650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:44:25.802395 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:25.814603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:25.873821 tst ping.py: using LAC 38312 03:44:26.000577 tst ping.py: using RAC 62 03:44:26.126889 tst ping.py: using CellId 38312 03:44:26.255337 tst ping.py: using BVCI 38313 03:44:26.375268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.386722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.398585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.409896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.421463 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.432874 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.444735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:26.456342 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:26.577558 tst ping.py:19: start network... 03:44:26.795042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:27.296940 run create_hlr_db(pid=4759): Launched 03:44:27.419634 bus /gobi_6: Setting Powered False 03:44:28.483980 run create_hlr_db(pid=4759): Terminated: ok {rc=0} 03:44:28.916905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Launched 03:44:29.221220 run osmo-hlr_10.42.42.2(pid=4762): Launched 03:44:29.335892 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:29.860278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Launched 03:44:30.163961 run osmo-stp_10.42.42.5(pid=4765): Launched 03:44:30.278433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:30.799483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Launched 03:44:30.940543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:31.224767 run patchelf(pid=4768): Launched 03:44:31.421696 run osmo-stp_10.42.42.5(pid=4765): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] 03:44:31.564024 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-14_03:44:30.105978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:31.709640 run osmo-stp_10.42.42.5(pid=4765): stderr: | [0;m[38;5;43m20221214034430278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034430279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034430279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034430279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:31.852618 run osmo-stp_10.42.42.5(pid=4765): stdout: | (launched: 2022-12-14_03:44:30.105978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:31.990808 run osmo-stp_10.42.42.5(pid=4765): stderr: | [0;m[38;5;43m20221214034430278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034430279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034430279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034430279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034430280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:32.152798 run patchelf(pid=4768): Terminating (SIGINT) 03:44:32.333867 run patchelf(pid=4768): Terminated: ok {rc=0} 03:44:32.464849 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 03:44:32.474876 tst ping.py:22: Test FAILED (6.7 sec) 03:44:32.503426 run osmo-hlr_10.42.42.2(pid=4762): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4762)] 03:44:32.555348 run osmo-hlr_10.42.42.2(pid=4762): stdout: | (launched: 2022-12-14_03:44:29.163395) 03:44:32.608911 run osmo-hlr_10.42.42.2(pid=4762): stderr: | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034429342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034429354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034429363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034429363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034429363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:32.662093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminating (SIGTERM) 03:44:32.704349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminating (SIGTERM) 03:44:32.747423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Terminating (SIGTERM) 03:44:32.790064 --- ParallelTerminationStrategy: PID 4761 died... 03:44:32.810912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4761): Terminated: ok {rc=0} 03:44:32.857914 --- ParallelTerminationStrategy: PID 4764 died... 03:44:32.878118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4764): Terminated: ok {rc=0} 03:44:32.925023 --- ParallelTerminationStrategy: PID 4767 died... 03:44:32.945315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4767): Terminated: ok {rc=0} 03:44:33.034085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:44:34.122496 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.134588 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:44:34.193316 tst ping_idle_ping.py: using LAC 38313 03:44:34.312556 tst ping_idle_ping.py: using RAC 63 03:44:34.430734 tst ping_idle_ping.py: using CellId 38313 03:44:34.550202 tst ping_idle_ping.py: using BVCI 38314 03:44:34.661892 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.672926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.683744 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.694509 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.705193 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.715879 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.726830 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:44:34.737600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:44:34.851552 tst ping_idle_ping.py:24: start network... 03:44:35.052469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:35.524278 run create_hlr_db(pid=4769): Launched 03:44:35.647788 bus /gobi_6: Setting Powered False 03:44:36.709056 run create_hlr_db(pid=4769): Terminated: ok {rc=0} 03:44:37.154859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Launched 03:44:37.483488 run osmo-hlr_10.42.42.2(pid=4772): Launched 03:44:37.607569 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:38.167792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Launched 03:44:38.495175 run osmo-stp_10.42.42.5(pid=4775): Launched 03:44:38.613960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:39.141374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Launched 03:44:39.256906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:39.514487 run patchelf(pid=4778): Launched 03:44:39.682312 run osmo-stp_10.42.42.5(pid=4775): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] 03:44:39.809998 run osmo-stp_10.42.42.5(pid=4775): stdout: | (launched: 2022-12-14_03:44:38.434146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:39.940067 run osmo-stp_10.42.42.5(pid=4775): stderr: | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034438610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:40.070119 run osmo-stp_10.42.42.5(pid=4775): stdout: | (launched: 2022-12-14_03:44:38.434146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:40.193715 run osmo-stp_10.42.42.5(pid=4775): stderr: | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034438609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034438610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034438610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:40.340292 run patchelf(pid=4778): Terminating (SIGINT) 03:44:40.509269 run patchelf(pid=4778): Terminated: ok {rc=0} 03:44:40.630875 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4775): Process ended prematurely: osmo-stp_10.42.42.5(pid=4775) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:44:40.639833 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:44:40.666950 run osmo-hlr_10.42.42.2(pid=4772): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4772)] 03:44:40.714423 run osmo-hlr_10.42.42.2(pid=4772): stdout: | (launched: 2022-12-14_03:44:37.421561) 03:44:40.763872 run osmo-hlr_10.42.42.2(pid=4772): stderr: | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034437623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034437635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034437643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034437643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034437643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:40.813801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Terminating (SIGTERM) 03:44:40.853431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Terminating (SIGTERM) 03:44:40.892835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Terminating (SIGTERM) 03:44:40.932579 --- ParallelTerminationStrategy: PID 4771 died... 03:44:40.951655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Terminated: ok {rc=0} 03:44:40.995361 --- ParallelTerminationStrategy: PID 4774 died... 03:44:41.014096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Terminated: ok {rc=0} 03:44:41.057900 --- ParallelTerminationStrategy: PID 4777 died... 03:44:41.076513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Terminated: ok {rc=0} 03:44:41.161834 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:44:42.449112 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:42.455461 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:44:42.475984 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:44:42.510201 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:44:42.564303 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:44:42.586262 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:44:42.621215 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:44:43.175441 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:44:43.180430 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.191671 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:44:43.247622 tst switch_tch_pdch.py: using LAC 38314 03:44:43.367725 tst switch_tch_pdch.py: using RAC 64 03:44:43.484856 tst switch_tch_pdch.py: using CellId 38314 03:44:43.602577 tst switch_tch_pdch.py: using BVCI 38315 03:44:43.713066 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.724187 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.735181 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.746117 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.756906 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.767860 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.778953 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:44:43.789876 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:44:43.910296 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:44:44.027717 tst switch_tch_pdch.py:51: start network... 03:44:44.227788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:44.696175 run create_hlr_db(pid=4784): Launched 03:44:44.818183 bus /gobi_6: Setting Powered False 03:44:45.885308 run create_hlr_db(pid=4784): Terminated: ok {rc=0} 03:44:46.356261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Launched 03:44:46.703739 run osmo-hlr_10.42.42.2(pid=4787): Launched 03:44:46.950036 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:47.602526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Launched 03:44:47.926115 run osmo-stp_10.42.42.5(pid=4790): Launched 03:44:48.048913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:44:48.607561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4792): Launched 03:44:48.731118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:44:49.005296 run patchelf(pid=4793): Launched 03:44:49.184078 run osmo-stp_10.42.42.5(pid=4790): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] 03:44:49.321244 run osmo-stp_10.42.42.5(pid=4790): stdout: | (launched: 2022-12-14_03:44:47.865093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:49.460353 run osmo-stp_10.42.42.5(pid=4790): stderr: | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034448062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:49.599231 run osmo-stp_10.42.42.5(pid=4790): stdout: | (launched: 2022-12-14_03:44:47.865093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:44:49.731764 run osmo-stp_10.42.42.5(pid=4790): stderr: | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034448061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034448062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034448062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:44:49.888919 run patchelf(pid=4793): Terminating (SIGINT) 03:44:50.070658 run patchelf(pid=4793): Terminated: ok {rc=0} 03:44:50.201730 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4790): Process ended prematurely: osmo-stp_10.42.42.5(pid=4790) [trial-2399↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] [trial-2399↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:44:50.211342 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 03:44:50.239701 run osmo-hlr_10.42.42.2(pid=4787): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4787)] 03:44:50.290755 run osmo-hlr_10.42.42.2(pid=4787): stdout: | (launched: 2022-12-14_03:44:46.638416) 03:44:50.343598 run osmo-hlr_10.42.42.2(pid=4787): stderr: | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034446956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034446971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034446989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034446989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034446989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:44:50.396552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Terminating (SIGTERM) 03:44:50.438491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Terminating (SIGTERM) 03:44:50.481196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4792): Terminating (SIGTERM) 03:44:50.523603 --- ParallelTerminationStrategy: PID 4786 died... 03:44:50.544069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4786): Terminated: ok {rc=0} 03:44:50.590752 --- ParallelTerminationStrategy: PID 4789 died... 03:44:50.610812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4789): Terminated: ok {rc=0} 03:44:50.657336 --- ParallelTerminationStrategy: PID 4792 died... 03:44:50.677266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4792): Terminated: ok {rc=0} 03:44:50.765100 bus /gobi_0: Setting Powered False 03:44:51.863936 bus /gobi_0: Setting Powered False 03:44:52.975587 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:44:54.212441 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:44:54.218201 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:44:54.238603 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:44:54.272357 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:44:54.324919 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:44:54.346033 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:44:54.380031 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:44:54.935965 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:44:54.941648 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:54.953115 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:44:55.011505 tst switch_tch_pdch.py: using LAC 38315 03:44:55.139576 tst switch_tch_pdch.py: using RAC 65 03:44:55.267456 tst switch_tch_pdch.py: using CellId 38315 03:44:55.394664 tst switch_tch_pdch.py: using BVCI 38316 03:44:55.513782 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.525151 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.536305 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.547350 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.558726 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.570146 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.581900 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:44:55.593543 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:44:55.711281 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:44:55.827149 tst switch_tch_pdch.py:51: start network... 03:44:56.027591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:44:56.469435 run create_hlr_db(pid=4798): Launched 03:44:56.593277 bus /gobi_6: Setting Powered False 03:44:57.653663 run create_hlr_db(pid=4798): Terminated: ok {rc=0} 03:44:58.067750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Launched 03:44:58.392753 run osmo-hlr_10.42.42.2(pid=4801): Launched 03:44:58.516822 run osmo-stp_10.42.42.5: Starting osmo-stp 03:44:59.047342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Launched 03:44:59.373314 run osmo-stp_10.42.42.5(pid=4804): Launched 03:44:59.496677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:45:00.028753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Launched 03:45:00.152023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:45:00.428023 run patchelf(pid=4807): Launched 03:45:00.607771 run osmo-stp_10.42.42.5(pid=4804): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] 03:45:00.744699 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-14_03:44:59.311649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:00.891621 run osmo-stp_10.42.42.5(pid=4804): stderr: | [0;m[38;5;43m20221214034459508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034459508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034459509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034459509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:01.044318 run osmo-stp_10.42.42.5(pid=4804): stdout: | (launched: 2022-12-14_03:44:59.311649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:01.180221 run osmo-stp_10.42.42.5(pid=4804): stderr: | [0;m[38;5;43m20221214034459508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034459508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034459509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034459509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034459510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:01.341577 run patchelf(pid=4807): Terminating (SIGINT) 03:45:01.539511 run patchelf(pid=4807): Terminated: ok {rc=0} 03:45:01.673155 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2399↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] [trial-2399↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:45:01.683830 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 03:45:01.713094 run osmo-hlr_10.42.42.2(pid=4801): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4801)] 03:45:01.767785 run osmo-hlr_10.42.42.2(pid=4801): stdout: | (launched: 2022-12-14_03:44:58.331447) 03:45:01.822238 run osmo-hlr_10.42.42.2(pid=4801): stderr: | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034458532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034458548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034458558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034458558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034458558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:01.877595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminating (SIGTERM) 03:45:01.920734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminating (SIGTERM) 03:45:01.964731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Terminating (SIGTERM) 03:45:02.009187 --- ParallelTerminationStrategy: PID 4800 died... 03:45:02.031081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4800): Terminated: ok {rc=0} 03:45:02.079682 --- ParallelTerminationStrategy: PID 4803 died... 03:45:02.101466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4803): Terminated: ok {rc=0} 03:45:02.150341 --- ParallelTerminationStrategy: PID 4806 died... 03:45:02.172112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4806): Terminated: ok {rc=0} 03:45:02.264423 bus /gobi_0: Setting Powered False 03:45:03.367443 bus /gobi_0: Setting Powered False 03:45:04.486389 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:oc2g --------------------------------------------------------------------- 03:45:05.724404 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:05.728080 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 03:45:05.748500 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 03:45:05.755144 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 03:45:05.808162 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 03:45:05.829444 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 03:45:05.836414 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 03:45:06.369601 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:45:06.374471 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 03:45:06.385101 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 03:45:06.421636 tst mo_mt_sms.py: using LAC 38316 03:45:06.550254 tst mo_mt_sms.py: using RAC 66 03:45:06.675916 tst mo_mt_sms.py: using CellId 38316 03:45:06.805693 tst mo_mt_sms.py: using BVCI 38317 03:45:06.925586 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:45:07.040912 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 03:45:07.158336 tst mo_mt_sms.py:9: start nitb and bts... 03:45:07.376884 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:45:08.038521 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4814): Launched 03:45:08.364916 run osmo-nitb_10.42.42.2(pid=4815): Launched 03:45:08.546571 run osmo-nitb_10.42.42.2(pid=4815): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4815)] 03:45:08.691535 run osmo-nitb_10.42.42.2(pid=4815): stdout: | (launched: 2022-12-14_03:45:08.303909) 03:45:08.838341 run osmo-nitb_10.42.42.2(pid=4815): stderr: | (launched: 2022-12-14_03:45:08.351968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:08.985431 run osmo-nitb_10.42.42.2(pid=4815): stdout: | (launched: 2022-12-14_03:45:08.303909) 03:45:09.126109 run osmo-nitb_10.42.42.2(pid=4815): stderr: | (launched: 2022-12-14_03:45:08.351968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4815) [trial-2399↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4815)] 03:45:09.489363 tst osmo-nitb_10.42.42.2(pid=4815): stdout: | (launched: 2022-12-14_03:45:08.303909) 03:45:09.620208 tst osmo-nitb_10.42.42.2(pid=4815): stderr: | (launched: 2022-12-14_03:45:08.351968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:09.774684 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4815) [trial-2399↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4815)] [trial-2399↪nitb_sms:oc2g↪mo_mt_sms.py:11] 03:45:09.783908 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 03:45:09.791336 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4814): Terminating (SIGTERM) 03:45:10.002706 --- ParallelTerminationStrategy: PID 4814 died... 03:45:10.024714 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4814): Terminated: ok {rc=0} 03:45:10.115221 bus /sierra_3: Setting Powered False 03:45:11.216547 bus /sierra_3: Setting Powered False 03:45:12.334050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:oc2g --------------------------------------------------------------------- 03:45:13.515134 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:13.519014 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 03:45:13.539356 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 03:45:13.566043 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 03:45:13.622566 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 03:45:13.644468 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 03:45:13.672678 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 03:45:14.210946 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:oc2g mo_mt_sms.py ---------------------------------------------- 03:45:14.216089 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.226722 tst sms:oc2g: Using 1 x bts (candidates: 1) 03:45:14.263749 tst mo_mt_sms.py: using LAC 38317 03:45:14.380039 tst mo_mt_sms.py: using RAC 67 03:45:14.506605 tst mo_mt_sms.py: using CellId 38317 03:45:14.631444 tst mo_mt_sms.py: using BVCI 38318 03:45:14.750736 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.761763 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.772502 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.783213 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.794317 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 03:45:14.805470 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:45:14.924377 tst sms:oc2g: Using 1 x modem (candidates: 2) 03:45:15.044045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:15.548386 run create_hlr_db(pid=4820): Launched 03:45:15.671340 bus /sierra_2: Setting Powered False 03:45:16.733792 run create_hlr_db(pid=4820): Terminated: ok {rc=0} 03:45:17.194411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Launched 03:45:17.528402 run osmo-hlr_10.42.42.2(pid=4823): Launched 03:45:17.652750 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:18.213190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Launched 03:45:18.538636 run osmo-stp_10.42.42.5(pid=4826): Launched 03:45:18.662849 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:19.249746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Launched 03:45:19.575862 run osmo-msc_10.42.42.6(pid=4829): Launched 03:45:19.756655 run osmo-stp_10.42.42.5(pid=4826): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] 03:45:19.893580 run osmo-stp_10.42.42.5(pid=4826): stdout: | (launched: 2022-12-14_03:45:18.477444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:20.031039 run osmo-stp_10.42.42.5(pid=4826): stderr: | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034518674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:20.167812 run osmo-stp_10.42.42.5(pid=4826): stdout: | (launched: 2022-12-14_03:45:18.477444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:20.296593 run osmo-stp_10.42.42.5(pid=4826): stderr: | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034518673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034518674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034518674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:20.451606 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4826): Process ended prematurely: osmo-stp_10.42.42.5(pid=4826) [trial-2399↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] [trial-2399↪sms:oc2g↪mo_mt_sms.py:16] 03:45:20.460353 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 03:45:20.487705 run osmo-hlr_10.42.42.2(pid=4823): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4823)] 03:45:20.538662 run osmo-hlr_10.42.42.2(pid=4823): stdout: | (launched: 2022-12-14_03:45:17.467047) 03:45:20.591209 run osmo-hlr_10.42.42.2(pid=4823): stderr: | [0;m[1;31m20221214034517667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034517668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034517668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034517668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034517668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034517668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034517679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034517687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034517688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034517688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:20.664001 run osmo-msc_10.42.42.6(pid=4829): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4829)] 03:45:20.714048 run osmo-msc_10.42.42.6(pid=4829): stdout: | (launched: 2022-12-14_03:45:19.514498) 03:45:20.766479 run osmo-msc_10.42.42.6(pid=4829): stderr: | [0;m[38;5;43m20221214034519837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034519837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f807734ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034519837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034519837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034519837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034519838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034519839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034519840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034519840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034519840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:20.819162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Terminating (SIGTERM) 03:45:20.860651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Terminating (SIGTERM) 03:45:20.902577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Terminating (SIGTERM) 03:45:20.944771 --- ParallelTerminationStrategy: PID 4822 died... 03:45:20.965195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4822): Terminated: ok {rc=0} 03:45:21.011872 --- ParallelTerminationStrategy: PID 4825 died... 03:45:21.031729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4825): Terminated: ok {rc=0} 03:45:21.078255 --- ParallelTerminationStrategy: PID 4828 died... 03:45:21.098295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4828): Terminated: ok {rc=0} 03:45:21.186074 bus /sierra_3: Setting Powered False 03:45:22.286612 bus /sierra_3: Setting Powered False 03:45:23.405458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:oc2g --------------------------------------------------------------------- 03:45:24.624746 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:24.628920 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:24.650029 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 03:45:24.657204 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:24.698941 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:24.721449 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 03:45:24.728541 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:25.243793 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:25.249350 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 03:45:25.260468 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:25.295024 tst assert_extension.py: using LAC 38318 03:45:25.423279 tst assert_extension.py: using RAC 68 03:45:25.552351 tst assert_extension.py: using CellId 38318 03:45:25.681120 tst assert_extension.py: using BVCI 38319 03:45:25.800493 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:25.914804 tst assert_extension.py:10: start nitb and bts... 03:45:26.116036 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:45:26.732386 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4834): Launched 03:45:27.035708 run osmo-nitb_10.42.42.2(pid=4835): Launched 03:45:27.202464 run osmo-nitb_10.42.42.2(pid=4835): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4835)] 03:45:27.337444 run osmo-nitb_10.42.42.2(pid=4835): stdout: | (launched: 2022-12-14_03:45:26.977658) 03:45:27.474123 run osmo-nitb_10.42.42.2(pid=4835): stderr: | (launched: 2022-12-14_03:45:27.022696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:27.611111 run osmo-nitb_10.42.42.2(pid=4835): stdout: | (launched: 2022-12-14_03:45:26.977658) 03:45:27.741297 run osmo-nitb_10.42.42.2(pid=4835): stderr: | (launched: 2022-12-14_03:45:27.022696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4835) [trial-2399↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4835)] 03:45:28.149294 tst osmo-nitb_10.42.42.2(pid=4835): stdout: | (launched: 2022-12-14_03:45:26.977658) 03:45:28.270435 tst osmo-nitb_10.42.42.2(pid=4835): stderr: | (launched: 2022-12-14_03:45:27.022696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:45:28.414305 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4835) [trial-2399↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4835)] [trial-2399↪nitb_ussd:oc2g↪assert_extension.py:12] 03:45:28.422720 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:45:28.429530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4834): Terminating (SIGTERM) 03:45:28.638278 --- ParallelTerminationStrategy: PID 4834 died... 03:45:28.659570 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4834): Terminated: ok {rc=0} 03:45:28.744672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:oc2g --------------------------------------------------------------------- 03:45:29.910152 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:29.915772 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 03:45:29.937575 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 03:45:29.966429 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 03:45:30.002266 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 03:45:30.023015 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 03:45:30.049630 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 03:45:30.583162 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:oc2g assert_extension.py ---------------------------------------------- 03:45:30.589556 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:30.601257 tst ussd:oc2g: Using 1 x bts (candidates: 1) 03:45:30.638760 tst assert_extension.py: using LAC 38319 03:45:30.765051 tst assert_extension.py: using RAC 69 03:45:30.904034 tst assert_extension.py: using CellId 38319 03:45:31.033235 tst assert_extension.py: using BVCI 38320 03:45:31.183176 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:31.198028 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:31.211998 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:31.225275 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:31.239268 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 03:45:31.252658 tst ussd:oc2g: Using 1 x modem (candidates: 1) 03:45:31.398515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:31.960470 run create_hlr_db(pid=4839): Launched 03:45:32.116347 bus /sierra_2: Setting Powered False 03:45:33.176805 run create_hlr_db(pid=4839): Terminated: ok {rc=0} 03:45:33.600101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Launched 03:45:33.903637 run osmo-hlr_10.42.42.2(pid=4842): Launched 03:45:34.017476 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:34.544086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Launched 03:45:34.847844 run osmo-stp_10.42.42.5(pid=4845): Launched 03:45:34.962861 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:35.510368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Launched 03:45:35.813190 run osmo-msc_10.42.42.6(pid=4848): Launched 03:45:35.980905 run osmo-stp_10.42.42.5(pid=4845): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] 03:45:36.108404 run osmo-stp_10.42.42.5(pid=4845): stdout: | (launched: 2022-12-14_03:45:34.790102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:36.235972 run osmo-stp_10.42.42.5(pid=4845): stderr: | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034534963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:36.361334 run osmo-stp_10.42.42.5(pid=4845): stdout: | (launched: 2022-12-14_03:45:34.790102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:36.480700 run osmo-stp_10.42.42.5(pid=4845): stderr: | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034534963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034534963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034534964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:36.623838 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4845): Process ended prematurely: osmo-stp_10.42.42.5(pid=4845) [trial-2399↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] [trial-2399↪ussd:oc2g↪assert_extension.py:17] 03:45:36.632149 tst assert_extension.py:17: Test FAILED (6.0 sec) 03:45:36.658462 run osmo-hlr_10.42.42.2(pid=4842): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4842)] 03:45:36.706381 run osmo-hlr_10.42.42.2(pid=4842): stdout: | (launched: 2022-12-14_03:45:33.845240) 03:45:36.755682 run osmo-hlr_10.42.42.2(pid=4842): stderr: | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034534022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034534034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034534043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034534044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034534044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:36.824893 run osmo-msc_10.42.42.6(pid=4848): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4848)] 03:45:36.872893 run osmo-msc_10.42.42.6(pid=4848): stdout: | (launched: 2022-12-14_03:45:35.755130) 03:45:36.922301 run osmo-msc_10.42.42.6(pid=4848): stderr: | [0;m[38;5;43m20221214034536028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034536028 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd713e05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034536028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034536028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034536028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034536029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034536030 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034536031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034536031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034536031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:36.972169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminating (SIGTERM) 03:45:37.011833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Terminating (SIGTERM) 03:45:37.051676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Terminating (SIGTERM) 03:45:37.091476 --- ParallelTerminationStrategy: PID 4841 died... 03:45:37.111078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminated: ok {rc=0} 03:45:37.155136 --- ParallelTerminationStrategy: PID 4844 died... 03:45:37.173887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4844): Terminated: ok {rc=0} 03:45:37.217726 --- ParallelTerminationStrategy: PID 4847 died... 03:45:37.236328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4847): Terminated: ok {rc=0} 03:45:37.320388 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:45:38.511969 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:38.518588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:45:38.539021 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:45:38.565408 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:45:38.617085 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:45:38.637628 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:45:38.664411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:45:39.215082 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:45:39.265328 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.276411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:45:39.337749 tst mo_mt_call.py: using LAC 38320 03:45:39.467913 tst mo_mt_call.py: using RAC 70 03:45:39.596166 tst mo_mt_call.py: using CellId 38320 03:45:39.725766 tst mo_mt_call.py: using BVCI 38321 03:45:39.847866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.859438 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.870740 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.882008 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.893718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:39.905304 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:40.022119 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:40.144492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:40.627581 run create_hlr_db(pid=4854): Launched 03:45:40.754260 bus /sierra_2: Setting Powered False 03:45:41.814383 run create_hlr_db(pid=4854): Terminated: ok {rc=0} 03:45:42.245328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4856): Launched 03:45:42.556628 run osmo-hlr_10.42.42.2(pid=4857): Launched 03:45:42.673549 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:43.223638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4859): Launched 03:45:43.532899 run osmo-stp_10.42.42.5(pid=4860): Launched 03:45:43.651138 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:44.210060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4862): Launched 03:45:44.519642 run osmo-msc_10.42.42.6(pid=4863): Launched 03:45:44.691484 run osmo-stp_10.42.42.5(pid=4860): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4860)] 03:45:44.821730 run osmo-stp_10.42.42.5(pid=4860): stdout: | (launched: 2022-12-14_03:45:43.473738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:44.951994 run osmo-stp_10.42.42.5(pid=4860): stderr: | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034543648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:45.079265 run osmo-stp_10.42.42.5(pid=4860): stdout: | (launched: 2022-12-14_03:45:43.473738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:45.201932 run osmo-stp_10.42.42.5(pid=4860): stderr: | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034543648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034543648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034543649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:45.347882 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4860): Process ended prematurely: osmo-stp_10.42.42.5(pid=4860) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4860)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:45:45.356775 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:45:45.383214 run osmo-hlr_10.42.42.2(pid=4857): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4857)] 03:45:45.431641 run osmo-hlr_10.42.42.2(pid=4857): stdout: | (launched: 2022-12-14_03:45:42.497615) 03:45:45.481260 run osmo-hlr_10.42.42.2(pid=4857): stderr: | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034542679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034542697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034542706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034542706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034542706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:45.550830 run osmo-msc_10.42.42.6(pid=4863): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4863)] 03:45:45.598845 run osmo-msc_10.42.42.6(pid=4863): stdout: | (launched: 2022-12-14_03:45:44.460526) 03:45:45.648595 run osmo-msc_10.42.42.6(pid=4863): stderr: | [0;m[38;5;43m20221214034544735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034544735 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ddbebec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034544735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034544735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034544736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034544736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034544738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034544738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034544738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034544738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:45.698695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4856): Terminating (SIGTERM) 03:45:45.738439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4859): Terminating (SIGTERM) 03:45:45.778285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4862): Terminating (SIGTERM) 03:45:45.818377 --- ParallelTerminationStrategy: PID 4856 died... 03:45:45.841384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4856): Terminated: ok {rc=0} 03:45:45.886942 --- ParallelTerminationStrategy: PID 4859 died... 03:45:45.906567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4859): Terminated: ok {rc=0} 03:45:45.952217 --- ParallelTerminationStrategy: PID 4862 died... 03:45:45.971817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4862): Terminated: ok {rc=0} 03:45:46.058334 bus /sierra_3: Setting Powered False 03:45:47.164168 bus /sierra_3: Setting Powered False 03:45:48.293663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:45:49.440098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:49.451983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:45:49.508706 tst mo_mt_call_osmux.py: using LAC 38321 03:45:49.630618 tst mo_mt_call_osmux.py: using RAC 71 03:45:49.752634 tst mo_mt_call_osmux.py: using CellId 38321 03:45:49.874228 tst mo_mt_call_osmux.py: using BVCI 38322 03:45:49.985750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:49.996851 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:50.008012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:50.019068 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:50.029966 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:45:50.041031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:50.156354 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:45:50.278324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:45:50.792671 run create_hlr_db(pid=4865): Launched 03:45:50.919094 bus /sierra_2: Setting Powered False 03:45:51.985140 run create_hlr_db(pid=4865): Terminated: ok {rc=0} 03:45:52.428524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Launched 03:45:52.738313 run osmo-hlr_10.42.42.2(pid=4869): Launched 03:45:52.855377 run osmo-stp_10.42.42.5: Starting osmo-stp 03:45:53.403745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Launched 03:45:53.712472 run osmo-stp_10.42.42.5(pid=4872): Launched 03:45:53.830273 run osmo-msc_10.42.42.6: Starting osmo-msc 03:45:54.386637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4874): Launched 03:45:54.694327 run osmo-msc_10.42.42.6(pid=4875): Launched 03:45:54.865248 run osmo-stp_10.42.42.5(pid=4872): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] 03:45:54.994674 run osmo-stp_10.42.42.5(pid=4872): stdout: | (launched: 2022-12-14_03:45:53.653694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:55.123708 run osmo-stp_10.42.42.5(pid=4872): stderr: | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034553826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:55.252235 run osmo-stp_10.42.42.5(pid=4872): stdout: | (launched: 2022-12-14_03:45:53.653694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:45:55.374327 run osmo-stp_10.42.42.5(pid=4872): stderr: | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034553826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034553826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034553829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:45:55.520253 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4872): Process ended prematurely: osmo-stp_10.42.42.5(pid=4872) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:45:55.529094 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:45:55.555373 run osmo-hlr_10.42.42.2(pid=4869): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4869)] 03:45:55.603749 run osmo-hlr_10.42.42.2(pid=4869): stdout: | (launched: 2022-12-14_03:45:52.679521) 03:45:55.653230 run osmo-hlr_10.42.42.2(pid=4869): stderr: | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034552857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034552869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034552877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034552877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034552877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:45:55.722548 run osmo-msc_10.42.42.6(pid=4875): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4875)] 03:45:55.769536 run osmo-msc_10.42.42.6(pid=4875): stdout: | (launched: 2022-12-14_03:45:54.635384) 03:45:55.818319 run osmo-msc_10.42.42.6(pid=4875): stderr: | [0;m[38;5;43m20221214034554912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034554912 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b2cb0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034554912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034554912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034554912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034554912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034554914 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034554915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034554915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034554915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:45:55.867375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Terminating (SIGTERM) 03:45:55.906335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminating (SIGTERM) 03:45:55.945258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4874): Terminating (SIGTERM) 03:45:55.984665 --- ParallelTerminationStrategy: PID 4868 died... 03:45:56.003808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4868): Terminated: ok {rc=0} 03:45:56.047138 --- ParallelTerminationStrategy: PID 4871 died... 03:45:56.065602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminated: ok {rc=0} 03:45:56.108886 --- ParallelTerminationStrategy: PID 4874 died... 03:45:56.127778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4874): Terminated: ok {rc=0} 03:45:56.210243 bus /sierra_3: Setting Powered False 03:45:57.307408 bus /sierra_3: Setting Powered False 03:45:58.424264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:45:59.658148 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:45:59.664699 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:45:59.685245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:45:59.711918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:45:59.763296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:45:59.783745 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:45:59.810011 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:46:00.359777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:46:00.409419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:00.420585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:46:00.476872 tst mo_mt_call.py: using LAC 38322 03:46:00.601636 tst mo_mt_call.py: using RAC 72 03:46:00.722532 tst mo_mt_call.py: using CellId 38322 03:46:00.847262 tst mo_mt_call.py: using BVCI 38323 03:46:00.978315 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:00.990885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:01.003298 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:01.015809 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:01.029364 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:01.042907 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:01.167685 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:01.286189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:01.839131 run create_hlr_db(pid=4880): Launched 03:46:02.005227 bus /sierra_2: Setting Powered False 03:46:03.070903 run create_hlr_db(pid=4880): Terminated: ok {rc=0} 03:46:03.515132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4882): Launched 03:46:03.824453 run osmo-hlr_10.42.42.2(pid=4883): Launched 03:46:03.940769 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:04.486690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4885): Launched 03:46:04.794945 run osmo-stp_10.42.42.5(pid=4886): Launched 03:46:04.911986 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:05.469610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4888): Launched 03:46:05.778872 run osmo-msc_10.42.42.6(pid=4889): Launched 03:46:05.950170 run osmo-stp_10.42.42.5(pid=4886): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4886)] 03:46:06.078815 run osmo-stp_10.42.42.5(pid=4886): stdout: | (launched: 2022-12-14_03:46:04.736149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:06.207969 run osmo-stp_10.42.42.5(pid=4886): stderr: | [0;m[38;5;43m20221214034604909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034604909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034604910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034604910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034604912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034604913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034604913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:06.335771 run osmo-stp_10.42.42.5(pid=4886): stdout: | (launched: 2022-12-14_03:46:04.736149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:06.457218 run osmo-stp_10.42.42.5(pid=4886): stderr: | [0;m[38;5;43m20221214034604909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034604909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034604910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034604910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034604912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034604913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034604913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:06.602887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4886): Process ended prematurely: osmo-stp_10.42.42.5(pid=4886) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4886)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:46:06.611779 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:46:06.638310 run osmo-hlr_10.42.42.2(pid=4883): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4883)] 03:46:06.686397 run osmo-hlr_10.42.42.2(pid=4883): stdout: | (launched: 2022-12-14_03:46:03.765694) 03:46:06.736376 run osmo-hlr_10.42.42.2(pid=4883): stderr: | [0;m[1;31m20221214034603946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034603946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034603947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034603947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034603947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034603947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034603959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034603970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034603970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034603970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:06.805801 run osmo-msc_10.42.42.6(pid=4889): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4889)] 03:46:06.853754 run osmo-msc_10.42.42.6(pid=4889): stdout: | (launched: 2022-12-14_03:46:05.719794) 03:46:06.903264 run osmo-msc_10.42.42.6(pid=4889): stderr: | [0;m[38;5;43m20221214034605993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034605993 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0649a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034605993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034605993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034605993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034605993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034605995 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034605995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034605996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034605996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:06.953506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4882): Terminating (SIGTERM) 03:46:06.993407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4885): Terminating (SIGTERM) 03:46:07.033414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4888): Terminating (SIGTERM) 03:46:07.073509 --- ParallelTerminationStrategy: PID 4882 died... 03:46:07.092894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4882): Terminated: ok {rc=0} 03:46:07.137152 --- ParallelTerminationStrategy: PID 4885 died... 03:46:07.155769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4885): Terminated: ok {rc=0} 03:46:07.199481 --- ParallelTerminationStrategy: PID 4888 died... 03:46:07.218330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4888): Terminated: ok {rc=0} 03:46:07.304077 bus /sierra_3: Setting Powered False 03:46:08.404515 bus /sierra_3: Setting Powered False 03:46:09.521462 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:46:10.669476 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:10.681236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:46:10.737115 tst mo_mt_call_osmux.py: using LAC 38323 03:46:10.858784 tst mo_mt_call_osmux.py: using RAC 73 03:46:10.979034 tst mo_mt_call_osmux.py: using CellId 38323 03:46:11.100187 tst mo_mt_call_osmux.py: using BVCI 38324 03:46:11.211465 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:11.222535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:11.233345 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:11.244089 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:11.254960 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:46:11.265824 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:11.380297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:46:11.505657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:12.020898 run create_hlr_db(pid=4891): Launched 03:46:12.147551 bus /sierra_2: Setting Powered False 03:46:13.212319 run create_hlr_db(pid=4891): Terminated: ok {rc=0} 03:46:13.654171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4893): Launched 03:46:13.963031 run osmo-hlr_10.42.42.2(pid=4894): Launched 03:46:14.080454 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:14.630046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4896): Launched 03:46:14.938973 run osmo-stp_10.42.42.5(pid=4897): Launched 03:46:15.056507 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:15.615624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4899): Launched 03:46:15.945466 run osmo-msc_10.42.42.6(pid=4900): Launched 03:46:16.231251 run osmo-stp_10.42.42.5(pid=4897): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4897)] 03:46:16.519378 run osmo-stp_10.42.42.5(pid=4897): stdout: | (launched: 2022-12-14_03:46:14.880072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:16.820607 run osmo-stp_10.42.42.5(pid=4897): stderr: | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034615052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:16.990772 run osmo-stp_10.42.42.5(pid=4897): stdout: | (launched: 2022-12-14_03:46:14.880072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:17.115088 run osmo-stp_10.42.42.5(pid=4897): stderr: | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034615052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034615052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034615055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:17.263357 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4897): Process ended prematurely: osmo-stp_10.42.42.5(pid=4897) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4897)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:46:17.272836 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:46:17.300171 run osmo-hlr_10.42.42.2(pid=4894): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4894)] 03:46:17.348999 run osmo-hlr_10.42.42.2(pid=4894): stdout: | (launched: 2022-12-14_03:46:13.904039) 03:46:17.399483 run osmo-hlr_10.42.42.2(pid=4894): stderr: | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034614083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034614095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034614106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034614106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034614106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:17.469697 run osmo-msc_10.42.42.6(pid=4900): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4900)] 03:46:17.517685 run osmo-msc_10.42.42.6(pid=4900): stdout: | (launched: 2022-12-14_03:46:15.878449) 03:46:17.567533 run osmo-msc_10.42.42.6(pid=4900): stderr: | [0;m[38;5;43m20221214034616553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034616554 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3c55739c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034616554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034616554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034616555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034616557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034616563 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:17.617588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4893): Terminating (SIGTERM) 03:46:17.657100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4896): Terminating (SIGTERM) 03:46:17.696607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4899): Terminating (SIGTERM) 03:46:17.736282 --- ParallelTerminationStrategy: PID 4893 died... 03:46:17.755688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4893): Terminated: ok {rc=0} 03:46:17.799724 --- ParallelTerminationStrategy: PID 4896 died... 03:46:17.818502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4896): Terminated: ok {rc=0} 03:46:17.862358 --- ParallelTerminationStrategy: PID 4899 died... 03:46:17.881131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4899): Terminated: ok {rc=0} 03:46:17.966965 bus /sierra_3: Setting Powered False 03:46:19.066405 bus /sierra_3: Setting Powered False 03:46:20.182551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:46:21.414690 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:21.421385 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:46:21.442239 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:46:21.469642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:46:21.520448 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:46:21.541645 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:46:21.567987 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:46:22.121538 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:46:22.174950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.186594 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:46:22.242625 tst mo_mt_call.py: using LAC 38324 03:46:22.373458 tst mo_mt_call.py: using RAC 74 03:46:22.494388 tst mo_mt_call.py: using CellId 38324 03:46:22.616851 tst mo_mt_call.py: using BVCI 38325 03:46:22.728099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.739449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.750474 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.761598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.772477 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:22.783459 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:22.899239 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:23.018777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:23.534867 run create_hlr_db(pid=4905): Launched 03:46:23.662144 bus /sierra_2: Setting Powered False 03:46:24.726273 run create_hlr_db(pid=4905): Terminated: ok {rc=0} 03:46:25.167670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Launched 03:46:25.478843 run osmo-hlr_10.42.42.2(pid=4908): Launched 03:46:25.598432 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:26.129944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Launched 03:46:26.438859 run osmo-stp_10.42.42.5(pid=4911): Launched 03:46:26.555568 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:27.114773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Launched 03:46:27.424142 run osmo-msc_10.42.42.6(pid=4914): Launched 03:46:27.598162 run osmo-stp_10.42.42.5(pid=4911): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] 03:46:27.728324 run osmo-stp_10.42.42.5(pid=4911): stdout: | (launched: 2022-12-14_03:46:26.379705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:27.859091 run osmo-stp_10.42.42.5(pid=4911): stderr: | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034626556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:27.986640 run osmo-stp_10.42.42.5(pid=4911): stdout: | (launched: 2022-12-14_03:46:26.379705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:28.108566 run osmo-stp_10.42.42.5(pid=4911): stderr: | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034626555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034626556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034626556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:28.254394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4911): Process ended prematurely: osmo-stp_10.42.42.5(pid=4911) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:46:28.263128 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:46:28.289597 run osmo-hlr_10.42.42.2(pid=4908): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4908)] 03:46:28.337589 run osmo-hlr_10.42.42.2(pid=4908): stdout: | (launched: 2022-12-14_03:46:25.419961) 03:46:28.387062 run osmo-hlr_10.42.42.2(pid=4908): stderr: | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034625601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034625624 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034625634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034625634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034625634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:28.455979 run osmo-msc_10.42.42.6(pid=4914): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4914)] 03:46:28.503674 run osmo-msc_10.42.42.6(pid=4914): stdout: | (launched: 2022-12-14_03:46:27.365220) 03:46:28.553060 run osmo-msc_10.42.42.6(pid=4914): stderr: | [0;m[38;5;43m20221214034627642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034627642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8eb452cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034627642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034627642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034627642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034627642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034627644 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034627644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034627644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034627645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:28.602992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Terminating (SIGTERM) 03:46:28.642424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Terminating (SIGTERM) 03:46:28.681819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Terminating (SIGTERM) 03:46:28.721596 --- ParallelTerminationStrategy: PID 4907 died... 03:46:28.740705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4907): Terminated: ok {rc=0} 03:46:28.784482 --- ParallelTerminationStrategy: PID 4910 died... 03:46:28.803199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4910): Terminated: ok {rc=0} 03:46:28.847095 --- ParallelTerminationStrategy: PID 4913 died... 03:46:28.865754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4913): Terminated: ok {rc=0} 03:46:28.948641 bus /sierra_3: Setting Powered False 03:46:30.046549 bus /sierra_3: Setting Powered False 03:46:31.164612 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:46:32.319701 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.331953 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:46:32.389714 tst mo_mt_call_osmux.py: using LAC 38325 03:46:32.521715 tst mo_mt_call_osmux.py: using RAC 75 03:46:32.643317 tst mo_mt_call_osmux.py: using CellId 38325 03:46:32.766796 tst mo_mt_call_osmux.py: using BVCI 38326 03:46:32.877934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.889263 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.900321 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.911469 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.922399 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:46:32.933394 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:33.055418 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:46:33.172768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:33.651796 run create_hlr_db(pid=4916): Launched 03:46:33.777893 bus /sierra_2: Setting Powered False 03:46:34.839508 run create_hlr_db(pid=4916): Terminated: ok {rc=0} 03:46:35.291100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Launched 03:46:35.625106 run osmo-hlr_10.42.42.2(pid=4919): Launched 03:46:35.751380 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:36.322973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Launched 03:46:36.657037 run osmo-stp_10.42.42.5(pid=4922): Launched 03:46:36.783769 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:37.383109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4924): Launched 03:46:37.716671 run osmo-msc_10.42.42.6(pid=4925): Launched 03:46:37.901282 run osmo-stp_10.42.42.5(pid=4922): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] 03:46:38.040140 run osmo-stp_10.42.42.5(pid=4922): stdout: | (launched: 2022-12-14_03:46:36.594342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:38.179757 run osmo-stp_10.42.42.5(pid=4922): stderr: | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034636792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:38.317863 run osmo-stp_10.42.42.5(pid=4922): stdout: | (launched: 2022-12-14_03:46:36.594342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:38.449618 run osmo-stp_10.42.42.5(pid=4922): stderr: | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034636791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034636792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034636792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:38.606975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4922): Process ended prematurely: osmo-stp_10.42.42.5(pid=4922) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:46:38.616424 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:46:38.644785 run osmo-hlr_10.42.42.2(pid=4919): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4919)] 03:46:38.696490 run osmo-hlr_10.42.42.2(pid=4919): stdout: | (launched: 2022-12-14_03:46:35.562353) 03:46:38.749459 run osmo-hlr_10.42.42.2(pid=4919): stderr: | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034635766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034635779 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034635787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034635787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034635788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:38.823011 run osmo-msc_10.42.42.6(pid=4925): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4925)] 03:46:38.873568 run osmo-msc_10.42.42.6(pid=4925): stdout: | (launched: 2022-12-14_03:46:37.653999) 03:46:38.926407 run osmo-msc_10.42.42.6(pid=4925): stderr: | [0;m[38;5;43m20221214034637978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034637978 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a2df72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034637978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034637979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034637979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034637979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034637981 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034637981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034637981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034637981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:38.979343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Terminating (SIGTERM) 03:46:39.021276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Terminating (SIGTERM) 03:46:39.064032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4924): Terminating (SIGTERM) 03:46:39.106817 --- ParallelTerminationStrategy: PID 4918 died... 03:46:39.127297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4918): Terminated: ok {rc=0} 03:46:39.173876 --- ParallelTerminationStrategy: PID 4921 died... 03:46:39.193895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4921): Terminated: ok {rc=0} 03:46:39.240442 --- ParallelTerminationStrategy: PID 4924 died... 03:46:39.260441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4924): Terminated: ok {rc=0} 03:46:39.349826 bus /sierra_3: Setting Powered False 03:46:40.448571 bus /sierra_3: Setting Powered False 03:46:41.565609 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:46:42.807583 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:46:42.814809 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:46:42.835956 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:46:42.864250 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:46:42.917726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:46:42.938346 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:46:42.964881 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:46:43.514871 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:46:43.564262 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:43.575572 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:46:43.629684 tst mo_mt_call.py: using LAC 38326 03:46:43.750016 tst mo_mt_call.py: using RAC 76 03:46:43.869174 tst mo_mt_call.py: using CellId 38326 03:46:43.988227 tst mo_mt_call.py: using BVCI 38327 03:46:44.099046 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:44.110247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:44.121062 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:44.131761 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:44.142826 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:44.153866 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:44.275369 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:44.400209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:44.915065 run create_hlr_db(pid=4930): Launched 03:46:45.041824 bus /sierra_2: Setting Powered False 03:46:46.123619 run create_hlr_db(pid=4930): Terminated: ok {rc=0} 03:46:46.610295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Launched 03:46:46.946121 run osmo-hlr_10.42.42.2(pid=4933): Launched 03:46:47.203240 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:47.811832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Launched 03:46:48.142849 run osmo-stp_10.42.42.5(pid=4936): Launched 03:46:48.269610 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:48.869520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4938): Launched 03:46:49.202314 run osmo-msc_10.42.42.6(pid=4940): Launched 03:46:49.388688 run osmo-stp_10.42.42.5(pid=4936): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] 03:46:49.528815 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-14_03:46:48.080246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:49.668693 run osmo-stp_10.42.42.5(pid=4936): stderr: | [0;m[38;5;43m20221214034648274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034648275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034648275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034648275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:49.806769 run osmo-stp_10.42.42.5(pid=4936): stdout: | (launched: 2022-12-14_03:46:48.080246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:46:49.937613 run osmo-stp_10.42.42.5(pid=4936): stderr: | [0;m[38;5;43m20221214034648274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034648275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034648275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034648275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034648278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:46:50.094684 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:46:50.104372 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 03:46:50.132618 run osmo-hlr_10.42.42.2(pid=4933): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4933)] 03:46:50.183753 run osmo-hlr_10.42.42.2(pid=4933): stdout: | (launched: 2022-12-14_03:46:46.882075) 03:46:50.236360 run osmo-hlr_10.42.42.2(pid=4933): stderr: | [0;m[1;31m20221214034647127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034647127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034647127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034647128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034647128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034647128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034647143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034647157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034647157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034647161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:46:50.309351 run osmo-msc_10.42.42.6(pid=4940): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4940)] 03:46:50.359587 run osmo-msc_10.42.42.6(pid=4940): stdout: | (launched: 2022-12-14_03:46:49.139516) 03:46:50.412160 run osmo-msc_10.42.42.6(pid=4940): stderr: | [0;m[38;5;43m20221214034649463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034649464 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd4d3ea7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034649464 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034649464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034649464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034649464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034649466 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034649466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034649466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034649466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:46:50.465285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminating (SIGTERM) 03:46:50.507287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminating (SIGTERM) 03:46:50.550087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4938): Terminating (SIGTERM) 03:46:50.592793 --- ParallelTerminationStrategy: PID 4932 died... 03:46:50.613643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4932): Terminated: ok {rc=0} 03:46:50.660502 --- ParallelTerminationStrategy: PID 4935 died... 03:46:50.680736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4935): Terminated: ok {rc=0} 03:46:50.727462 --- ParallelTerminationStrategy: PID 4938 died... 03:46:50.747342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4938): Terminated: ok {rc=0} 03:46:50.836010 bus /sierra_3: Setting Powered False 03:46:51.934971 bus /sierra_3: Setting Powered False 03:46:53.053252 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:46:54.205986 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.218120 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:46:54.276200 tst mo_mt_call_osmux.py: using LAC 38327 03:46:54.405311 tst mo_mt_call_osmux.py: using RAC 77 03:46:54.535196 tst mo_mt_call_osmux.py: using CellId 38327 03:46:54.666063 tst mo_mt_call_osmux.py: using BVCI 38328 03:46:54.786237 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.797687 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.808743 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.819981 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.831587 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:46:54.843198 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:54.959133 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:46:55.080358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:46:55.566081 run create_hlr_db(pid=4942): Launched 03:46:55.693462 bus /sierra_2: Setting Powered False 03:46:56.754559 run create_hlr_db(pid=4942): Terminated: ok {rc=0} 03:46:57.207357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4944): Launched 03:46:57.541154 run osmo-hlr_10.42.42.2(pid=4945): Launched 03:46:57.667532 run osmo-stp_10.42.42.5: Starting osmo-stp 03:46:58.239802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4947): Launched 03:46:58.571878 run osmo-stp_10.42.42.5(pid=4948): Launched 03:46:58.698183 run osmo-msc_10.42.42.6: Starting osmo-msc 03:46:59.296221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4950): Launched 03:46:59.629261 run osmo-msc_10.42.42.6(pid=4951): Launched 03:46:59.814749 run osmo-stp_10.42.42.5(pid=4948): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4948)] 03:46:59.954005 run osmo-stp_10.42.42.5(pid=4948): stdout: | (launched: 2022-12-14_03:46:58.509780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:00.093676 run osmo-stp_10.42.42.5(pid=4948): stderr: | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034658706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:00.231865 run osmo-stp_10.42.42.5(pid=4948): stdout: | (launched: 2022-12-14_03:46:58.509780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:00.363121 run osmo-stp_10.42.42.5(pid=4948): stderr: | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034658706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034658706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034658707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:00.521184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4948): Process ended prematurely: osmo-stp_10.42.42.5(pid=4948) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4948)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:47:00.530725 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:47:00.558364 run osmo-hlr_10.42.42.2(pid=4945): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4945)] 03:47:00.608642 run osmo-hlr_10.42.42.2(pid=4945): stdout: | (launched: 2022-12-14_03:46:57.478543) 03:47:00.660918 run osmo-hlr_10.42.42.2(pid=4945): stderr: | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034657679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034657692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034657702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034657702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034657702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:00.733225 run osmo-msc_10.42.42.6(pid=4951): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4951)] 03:47:00.783058 run osmo-msc_10.42.42.6(pid=4951): stdout: | (launched: 2022-12-14_03:46:59.566691) 03:47:00.846171 run osmo-msc_10.42.42.6(pid=4951): stderr: | [0;m[38;5;43m20221214034659894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034659894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54d5b7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034659894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034659894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034659894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034659894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034659896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034659896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034659897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034659897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:00.916366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4944): Terminating (SIGTERM) 03:47:00.958795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4947): Terminating (SIGTERM) 03:47:01.002727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4950): Terminating (SIGTERM) 03:47:01.047236 --- ParallelTerminationStrategy: PID 4944 died... 03:47:01.068160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4944): Terminated: ok {rc=0} 03:47:01.116798 --- ParallelTerminationStrategy: PID 4947 died... 03:47:01.137217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4947): Terminated: ok {rc=0} 03:47:01.183976 --- ParallelTerminationStrategy: PID 4950 died... 03:47:01.204189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4950): Terminated: ok {rc=0} 03:47:01.295408 bus /sierra_3: Setting Powered False 03:47:02.402795 bus /sierra_3: Setting Powered False 03:47:03.515074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:47:04.755677 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:04.762722 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:47:04.783909 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:47:04.813710 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:47:04.867686 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:47:04.889099 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:47:04.917146 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:47:05.467915 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:47:05.520333 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:05.531320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:47:05.586795 tst mo_mt_call.py: using LAC 38328 03:47:05.722013 tst mo_mt_call.py: using RAC 78 03:47:05.858720 tst mo_mt_call.py: using CellId 38328 03:47:05.980002 tst mo_mt_call.py: using BVCI 38329 03:47:06.092484 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:06.103552 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:06.114341 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:06.125017 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:06.135805 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:06.146562 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:06.262887 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:06.384507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:06.901155 run create_hlr_db(pid=4956): Launched 03:47:07.029612 bus /sierra_2: Setting Powered False 03:47:08.091036 run create_hlr_db(pid=4956): Terminated: ok {rc=0} 03:47:08.552566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4958): Launched 03:47:08.885167 run osmo-hlr_10.42.42.2(pid=4959): Launched 03:47:09.012355 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:09.587673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4961): Launched 03:47:09.920751 run osmo-stp_10.42.42.5(pid=4962): Launched 03:47:10.047766 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:10.648360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4964): Launched 03:47:10.982647 run osmo-msc_10.42.42.6(pid=4965): Launched 03:47:11.167739 run osmo-stp_10.42.42.5(pid=4962): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4962)] 03:47:11.307214 run osmo-stp_10.42.42.5(pid=4962): stdout: | (launched: 2022-12-14_03:47:09.858635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:11.447689 run osmo-stp_10.42.42.5(pid=4962): stderr: | [0;m[38;5;43m20221214034710051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034710051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034710052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034710052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034710054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034710055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034710055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:11.586277 run osmo-stp_10.42.42.5(pid=4962): stdout: | (launched: 2022-12-14_03:47:09.858635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:11.717779 run osmo-stp_10.42.42.5(pid=4962): stderr: | [0;m[38;5;43m20221214034710051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034710051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034710052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034710052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034710054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034710055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034710055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:11.875730 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4962): Process ended prematurely: osmo-stp_10.42.42.5(pid=4962) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4962)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:47:11.885599 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:47:11.913908 run osmo-hlr_10.42.42.2(pid=4959): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4959)] 03:47:11.965303 run osmo-hlr_10.42.42.2(pid=4959): stdout: | (launched: 2022-12-14_03:47:08.822798) 03:47:12.017854 run osmo-hlr_10.42.42.2(pid=4959): stderr: | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034709024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034709036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034709044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034709045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034709045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:12.090934 run osmo-msc_10.42.42.6(pid=4965): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4965)] 03:47:12.141366 run osmo-msc_10.42.42.6(pid=4965): stdout: | (launched: 2022-12-14_03:47:10.919668) 03:47:12.193925 run osmo-msc_10.42.42.6(pid=4965): stderr: | [0;m[38;5;43m20221214034711243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034711243 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c3bd2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034711243 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034711243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034711243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034711243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034711245 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034711245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034711246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034711246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:12.246645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4958): Terminating (SIGTERM) 03:47:12.288587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4961): Terminating (SIGTERM) 03:47:12.331397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4964): Terminating (SIGTERM) 03:47:12.374331 --- ParallelTerminationStrategy: PID 4958 died... 03:47:12.395089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4958): Terminated: ok {rc=0} 03:47:12.442475 --- ParallelTerminationStrategy: PID 4961 died... 03:47:12.462776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4961): Terminated: ok {rc=0} 03:47:12.509868 --- ParallelTerminationStrategy: PID 4964 died... 03:47:12.530015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4964): Terminated: ok {rc=0} 03:47:12.618967 bus /sierra_3: Setting Powered False 03:47:13.718677 bus /sierra_3: Setting Powered False 03:47:14.835903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:47:15.985587 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:15.998607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:47:16.057395 tst mo_mt_call_osmux.py: using LAC 38329 03:47:16.186380 tst mo_mt_call_osmux.py: using RAC 79 03:47:16.314749 tst mo_mt_call_osmux.py: using CellId 38329 03:47:16.442348 tst mo_mt_call_osmux.py: using BVCI 38330 03:47:16.604728 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:16.620378 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:16.635887 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:16.654082 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:16.671341 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:47:16.689514 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:16.843241 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:47:16.993198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:17.574899 run create_hlr_db(pid=4967): Launched 03:47:17.701339 bus /sierra_2: Setting Powered False 03:47:18.766118 run create_hlr_db(pid=4967): Terminated: ok {rc=0} 03:47:19.207542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4969): Launched 03:47:19.517448 run osmo-hlr_10.42.42.2(pid=4970): Launched 03:47:19.637170 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:20.190947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4972): Launched 03:47:20.500159 run osmo-stp_10.42.42.5(pid=4973): Launched 03:47:20.619289 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:21.178239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4975): Launched 03:47:21.487849 run osmo-msc_10.42.42.6(pid=4976): Launched 03:47:21.660933 run osmo-stp_10.42.42.5(pid=4973): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4973)] 03:47:21.790397 run osmo-stp_10.42.42.5(pid=4973): stdout: | (launched: 2022-12-14_03:47:20.441327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:21.920160 run osmo-stp_10.42.42.5(pid=4973): stderr: | [0;m[38;5;43m20221214034720614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034720614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034720615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034720615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034720615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034720616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034720616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:22.049289 run osmo-stp_10.42.42.5(pid=4973): stdout: | (launched: 2022-12-14_03:47:20.441327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:22.171119 run osmo-stp_10.42.42.5(pid=4973): stderr: | [0;m[38;5;43m20221214034720614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034720614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034720615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034720615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034720615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034720616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034720616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:22.316459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4973): Process ended prematurely: osmo-stp_10.42.42.5(pid=4973) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4973)] [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:47:22.325209 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:47:22.351935 run osmo-hlr_10.42.42.2(pid=4970): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4970)] 03:47:22.399853 run osmo-hlr_10.42.42.2(pid=4970): stdout: | (launched: 2022-12-14_03:47:19.458242) 03:47:22.449423 run osmo-hlr_10.42.42.2(pid=4970): stderr: | [0;m[1;31m20221214034719637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034719637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034719637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034719638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034719638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034719638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034719650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034719658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034719658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034719658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:22.518753 run osmo-msc_10.42.42.6(pid=4976): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4976)] 03:47:22.566868 run osmo-msc_10.42.42.6(pid=4976): stdout: | (launched: 2022-12-14_03:47:21.428513) 03:47:22.616524 run osmo-msc_10.42.42.6(pid=4976): stderr: | [0;m[38;5;43m20221214034721702 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034721702 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1946f4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034721702 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034721702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034721702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034721702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034721704 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034721704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034721705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034721705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:22.666438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4969): Terminating (SIGTERM) 03:47:22.706108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4972): Terminating (SIGTERM) 03:47:22.745802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4975): Terminating (SIGTERM) 03:47:22.785677 --- ParallelTerminationStrategy: PID 4969 died... 03:47:22.804620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4969): Terminated: ok {rc=0} 03:47:22.848855 --- ParallelTerminationStrategy: PID 4972 died... 03:47:22.867621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4972): Terminated: ok {rc=0} 03:47:22.911584 --- ParallelTerminationStrategy: PID 4975 died... 03:47:22.930302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4975): Terminated: ok {rc=0} 03:47:23.016027 bus /sierra_3: Setting Powered False 03:47:24.116584 bus /sierra_3: Setting Powered False 03:47:25.232689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:47:26.473236 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:26.479426 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:47:26.499645 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:47:26.525968 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:47:26.578808 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:47:26.601248 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:47:26.629002 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:47:27.177486 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:47:27.233382 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.245178 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:27.309176 tst mo_mt_call.py: using LAC 38330 03:47:27.438104 tst mo_mt_call.py: using RAC 80 03:47:27.567042 tst mo_mt_call.py: using CellId 38330 03:47:27.695761 tst mo_mt_call.py: using BVCI 38331 03:47:27.815988 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.827567 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.839140 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.850439 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.861999 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:27.873732 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:27.992113 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:28.113291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:28.628401 run create_hlr_db(pid=4982): Launched 03:47:28.754456 bus /sierra_2: Setting Powered False 03:47:29.819251 run create_hlr_db(pid=4982): Terminated: ok {rc=0} 03:47:30.261748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Launched 03:47:30.572033 run osmo-hlr_10.42.42.2(pid=4985): Launched 03:47:30.689735 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:31.247816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Launched 03:47:31.577877 run osmo-stp_10.42.42.5(pid=4988): Launched 03:47:31.772330 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:32.438210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4990): Launched 03:47:32.747021 run osmo-msc_10.42.42.6(pid=4991): Launched 03:47:32.917891 run osmo-stp_10.42.42.5(pid=4988): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] 03:47:33.047650 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-14_03:47:31.514945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:33.177601 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034731871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:33.304872 run osmo-stp_10.42.42.5(pid=4988): stdout: | (launched: 2022-12-14_03:47:31.514945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:33.426120 run osmo-stp_10.42.42.5(pid=4988): stderr: | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034731870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034731871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034731871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:33.571642 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:47:33.580398 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:47:33.606940 run osmo-hlr_10.42.42.2(pid=4985): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4985)] 03:47:33.654510 run osmo-hlr_10.42.42.2(pid=4985): stdout: | (launched: 2022-12-14_03:47:30.512814) 03:47:33.703735 run osmo-hlr_10.42.42.2(pid=4985): stderr: | [0;m[1;31m20221214034730690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034730690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034730690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034730690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034730690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034730691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034730702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034730712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034730712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034730712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:33.772436 run osmo-msc_10.42.42.6(pid=4991): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4991)] 03:47:33.820024 run osmo-msc_10.42.42.6(pid=4991): stdout: | (launched: 2022-12-14_03:47:32.688000) 03:47:33.869168 run osmo-msc_10.42.42.6(pid=4991): stderr: | [0;m[38;5;43m20221214034732962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034732962 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8077126c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034732962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034732962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034732963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034732963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034732964 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034732965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034732965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034732965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:33.918823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Terminating (SIGTERM) 03:47:33.958196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminating (SIGTERM) 03:47:33.997427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4990): Terminating (SIGTERM) 03:47:34.037534 --- ParallelTerminationStrategy: PID 4984 died... 03:47:34.056758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4984): Terminated: ok {rc=0} 03:47:34.100540 --- ParallelTerminationStrategy: PID 4987 died... 03:47:34.119224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4987): Terminated: ok {rc=0} 03:47:34.163159 --- ParallelTerminationStrategy: PID 4990 died... 03:47:34.181761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4990): Terminated: ok {rc=0} 03:47:34.267553 bus /sierra_3: Setting Powered False 03:47:35.367546 bus /sierra_3: Setting Powered False 03:47:36.480600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:47:37.631819 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:37.644144 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:47:37.703473 tst mo_mt_call_osmux.py: using LAC 38331 03:47:37.834711 tst mo_mt_call_osmux.py: using RAC 81 03:47:37.966039 tst mo_mt_call_osmux.py: using CellId 38331 03:47:38.095440 tst mo_mt_call_osmux.py: using BVCI 38332 03:47:38.216356 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:38.227952 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:38.239335 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:38.250659 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:38.262337 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:47:38.274072 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:38.396798 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:47:38.516902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:38.998827 run create_hlr_db(pid=4993): Launched 03:47:39.125197 bus /sierra_2: Setting Powered False 03:47:40.186500 run create_hlr_db(pid=4993): Terminated: ok {rc=0} 03:47:40.637936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4995): Launched 03:47:40.969719 run osmo-hlr_10.42.42.2(pid=4996): Launched 03:47:41.095554 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:41.669497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4998): Launched 03:47:42.002927 run osmo-stp_10.42.42.5(pid=4999): Launched 03:47:42.129183 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:42.729287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5001): Launched 03:47:43.062141 run osmo-msc_10.42.42.6(pid=5002): Launched 03:47:43.246554 run osmo-stp_10.42.42.5(pid=4999): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4999)] 03:47:43.385929 run osmo-stp_10.42.42.5(pid=4999): stdout: | (launched: 2022-12-14_03:47:41.940166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:43.526494 run osmo-stp_10.42.42.5(pid=4999): stderr: | [0;m[38;5;43m20221214034742136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034742137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034742137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034742137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034742139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034742140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034742140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:43.666040 run osmo-stp_10.42.42.5(pid=4999): stdout: | (launched: 2022-12-14_03:47:41.940166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:43.797743 run osmo-stp_10.42.42.5(pid=4999): stderr: | [0;m[38;5;43m20221214034742136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034742137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034742137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034742137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034742139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034742140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034742140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:43.955227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4999): Process ended prematurely: osmo-stp_10.42.42.5(pid=4999) [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4999)] [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:47:43.964851 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:47:43.992876 run osmo-hlr_10.42.42.2(pid=4996): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4996)] 03:47:44.043728 run osmo-hlr_10.42.42.2(pid=4996): stdout: | (launched: 2022-12-14_03:47:40.907418) 03:47:44.096374 run osmo-hlr_10.42.42.2(pid=4996): stderr: | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034741108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034741121 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034741129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034741129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034741130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:44.169436 run osmo-msc_10.42.42.6(pid=5002): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5002)] 03:47:44.219578 run osmo-msc_10.42.42.6(pid=5002): stdout: | (launched: 2022-12-14_03:47:42.999361) 03:47:44.271833 run osmo-msc_10.42.42.6(pid=5002): stderr: | [0;m[38;5;43m20221214034743327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034743327 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bd6eadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034743327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034743327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034743327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034743327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034743329 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034743330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034743330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034743330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:44.324653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4995): Terminating (SIGTERM) 03:47:44.366526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4998): Terminating (SIGTERM) 03:47:44.409085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5001): Terminating (SIGTERM) 03:47:44.452159 --- ParallelTerminationStrategy: PID 4995 died... 03:47:44.472899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4995): Terminated: ok {rc=0} 03:47:44.520064 --- ParallelTerminationStrategy: PID 4998 died... 03:47:44.540248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4998): Terminated: ok {rc=0} 03:47:44.587076 --- ParallelTerminationStrategy: PID 5001 died... 03:47:44.607495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5001): Terminated: ok {rc=0} 03:47:44.696031 bus /sierra_3: Setting Powered False 03:47:45.794053 bus /sierra_3: Setting Powered False 03:47:46.936380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:47:48.170990 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:47:48.177180 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:47:48.197968 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:47:48.224827 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:47:48.276818 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:47:48.297807 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:47:48.324054 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:47:48.874987 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:47:48.929672 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:48.940903 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:47:48.998579 tst mo_mt_call.py: using LAC 38332 03:47:49.129378 tst mo_mt_call.py: using RAC 82 03:47:49.258299 tst mo_mt_call.py: using CellId 38332 03:47:49.387614 tst mo_mt_call.py: using BVCI 38333 03:47:49.508577 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:49.519925 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:49.531003 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:49.542099 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:49.553516 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:49.564850 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:49.683391 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:49.805428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:47:50.321654 run create_hlr_db(pid=5007): Launched 03:47:50.448849 bus /sierra_2: Setting Powered False 03:47:51.514451 run create_hlr_db(pid=5007): Terminated: ok {rc=0} 03:47:51.957347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5009): Launched 03:47:52.269323 run osmo-hlr_10.42.42.2(pid=5010): Launched 03:47:52.387600 run osmo-stp_10.42.42.5: Starting osmo-stp 03:47:52.923299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5012): Launched 03:47:53.233577 run osmo-stp_10.42.42.5(pid=5013): Launched 03:47:53.351300 run osmo-msc_10.42.42.6: Starting osmo-msc 03:47:53.911933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5015): Launched 03:47:54.222196 run osmo-msc_10.42.42.6(pid=5016): Launched 03:47:54.394582 run osmo-stp_10.42.42.5(pid=5013): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5013)] 03:47:54.524016 run osmo-stp_10.42.42.5(pid=5013): stdout: | (launched: 2022-12-14_03:47:53.174510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:54.653678 run osmo-stp_10.42.42.5(pid=5013): stderr: | [0;m[38;5;43m20221214034753350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034753350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034753351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034753351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034753351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034753352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034753352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:54.781442 run osmo-stp_10.42.42.5(pid=5013): stdout: | (launched: 2022-12-14_03:47:53.174510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:47:54.903144 run osmo-stp_10.42.42.5(pid=5013): stderr: | [0;m[38;5;43m20221214034753350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034753350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034753351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034753351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034753351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034753352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034753352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:47:55.048771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5013): Process ended prematurely: osmo-stp_10.42.42.5(pid=5013) [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5013)] [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:47:55.057894 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:47:55.084676 run osmo-hlr_10.42.42.2(pid=5010): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5010)] 03:47:55.132621 run osmo-hlr_10.42.42.2(pid=5010): stdout: | (launched: 2022-12-14_03:47:52.209988) 03:47:55.182260 run osmo-hlr_10.42.42.2(pid=5010): stderr: | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034752390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034752402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034752410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034752410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034752410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:47:55.251308 run osmo-msc_10.42.42.6(pid=5016): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5016)] 03:47:55.298785 run osmo-msc_10.42.42.6(pid=5016): stdout: | (launched: 2022-12-14_03:47:54.162718) 03:47:55.347741 run osmo-msc_10.42.42.6(pid=5016): stderr: | [0;m[38;5;43m20221214034754438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034754438 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5da2cb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034754438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034754439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034754439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034754439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034754441 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034754441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034754441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034754441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:47:55.397157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5009): Terminating (SIGTERM) 03:47:55.436429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5012): Terminating (SIGTERM) 03:47:55.475705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5015): Terminating (SIGTERM) 03:47:55.515677 --- ParallelTerminationStrategy: PID 5009 died... 03:47:55.535118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5009): Terminated: ok {rc=0} 03:47:55.579231 --- ParallelTerminationStrategy: PID 5012 died... 03:47:55.598065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5012): Terminated: ok {rc=0} 03:47:55.641925 --- ParallelTerminationStrategy: PID 5015 died... 03:47:55.660575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5015): Terminated: ok {rc=0} 03:47:55.746128 bus /sierra_3: Setting Powered False 03:47:56.846181 bus /sierra_3: Setting Powered False 03:47:57.962204 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:47:59.109466 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.121332 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:47:59.182898 tst mo_mt_call_osmux.py: using LAC 38333 03:47:59.303585 tst mo_mt_call_osmux.py: using RAC 83 03:47:59.423002 tst mo_mt_call_osmux.py: using CellId 38333 03:47:59.541914 tst mo_mt_call_osmux.py: using BVCI 38334 03:47:59.652829 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.663886 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.674650 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.685338 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.696063 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:47:59.706833 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:59.824229 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:47:59.945756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:00.460681 run create_hlr_db(pid=5018): Launched 03:48:00.588511 bus /sierra_2: Setting Powered False 03:48:01.653754 run create_hlr_db(pid=5018): Terminated: ok {rc=0} 03:48:02.126490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5020): Launched 03:48:02.470922 run osmo-hlr_10.42.42.2(pid=5021): Launched 03:48:02.599600 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:03.170827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5023): Launched 03:48:03.504489 run osmo-stp_10.42.42.5(pid=5024): Launched 03:48:03.630453 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:04.233421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5026): Launched 03:48:04.568113 run osmo-msc_10.42.42.6(pid=5027): Launched 03:48:04.751943 run osmo-stp_10.42.42.5(pid=5024): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5024)] 03:48:04.891622 run osmo-stp_10.42.42.5(pid=5024): stdout: | (launched: 2022-12-14_03:48:03.441727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:05.031623 run osmo-stp_10.42.42.5(pid=5024): stderr: | [0;m[38;5;43m20221214034803637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034803637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034803638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034803638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034803638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034803639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034803639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:05.170383 run osmo-stp_10.42.42.5(pid=5024): stdout: | (launched: 2022-12-14_03:48:03.441727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:05.301515 run osmo-stp_10.42.42.5(pid=5024): stderr: | [0;m[38;5;43m20221214034803637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034803637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034803638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034803638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034803638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034803639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034803639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:05.458512 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5024): Process ended prematurely: osmo-stp_10.42.42.5(pid=5024) [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5024)] [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:48:05.468433 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:48:05.496328 run osmo-hlr_10.42.42.2(pid=5021): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5021)] 03:48:05.546952 run osmo-hlr_10.42.42.2(pid=5021): stdout: | (launched: 2022-12-14_03:48:02.407873) 03:48:05.599106 run osmo-hlr_10.42.42.2(pid=5021): stderr: | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034802614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034802626 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034802634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034802634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034802634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:05.671739 run osmo-msc_10.42.42.6(pid=5027): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5027)] 03:48:05.721652 run osmo-msc_10.42.42.6(pid=5027): stdout: | (launched: 2022-12-14_03:48:04.505280) 03:48:05.773860 run osmo-msc_10.42.42.6(pid=5027): stderr: | [0;m[38;5;43m20221214034804832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034804832 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f655dc80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034804832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034804832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034804832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034804833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034804834 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034804835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034804835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034804835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:05.826409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5020): Terminating (SIGTERM) 03:48:05.867934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5023): Terminating (SIGTERM) 03:48:05.910316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5026): Terminating (SIGTERM) 03:48:05.952667 --- ParallelTerminationStrategy: PID 5020 died... 03:48:05.973090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5020): Terminated: ok {rc=0} 03:48:06.019219 --- ParallelTerminationStrategy: PID 5023 died... 03:48:06.038844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5023): Terminated: ok {rc=0} 03:48:06.085185 --- ParallelTerminationStrategy: PID 5026 died... 03:48:06.104857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5026): Terminated: ok {rc=0} 03:48:06.193764 bus /sierra_3: Setting Powered False 03:48:07.291906 bus /sierra_3: Setting Powered False 03:48:08.409364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:oc2g --------------------------------------------------------------------- 03:48:09.640923 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:09.645789 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 03:48:09.666565 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 03:48:09.693407 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 03:48:09.777573 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 03:48:09.798070 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 03:48:09.824370 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 03:48:10.409970 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 03:48:10.415125 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.425894 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:48:10.460556 tst emergency_mo_mt_call.py: using LAC 38334 03:48:10.577806 tst emergency_mo_mt_call.py: using RAC 84 03:48:10.693602 tst emergency_mo_mt_call.py: using CellId 38334 03:48:10.809541 tst emergency_mo_mt_call.py: using BVCI 38335 03:48:10.931171 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.942564 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.953685 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.964590 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.976439 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:10.987732 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:11.103772 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:11.225340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:11.731276 run create_hlr_db(pid=5032): Launched 03:48:11.854414 bus /sierra_2: Setting Powered False 03:48:12.918695 run create_hlr_db(pid=5032): Terminated: ok {rc=0} 03:48:13.372723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5034): Launched 03:48:13.699904 run osmo-hlr_10.42.42.2(pid=5035): Launched 03:48:13.823931 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:14.390033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5037): Launched 03:48:14.718314 run osmo-stp_10.42.42.5(pid=5038): Launched 03:48:14.851816 tst emergency_mo_mt_call.py: using MSISDN 8492 03:48:15.014020 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:15.600742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5040): Launched 03:48:15.938304 run osmo-msc_10.42.42.6(pid=5041): Launched 03:48:16.293212 run osmo-stp_10.42.42.5(pid=5038): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5038)] 03:48:16.635131 run osmo-stp_10.42.42.5(pid=5038): stdout: | (launched: 2022-12-14_03:48:14.656598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:16.854532 run osmo-stp_10.42.42.5(pid=5038): stderr: | [0;m[38;5;43m20221214034814852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034814853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034814853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034814853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034814855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034814856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034814856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:17.059064 run osmo-stp_10.42.42.5(pid=5038): stdout: | (launched: 2022-12-14_03:48:14.656598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:17.191304 run osmo-stp_10.42.42.5(pid=5038): stderr: | [0;m[38;5;43m20221214034814852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034814853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034814853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034814853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034814855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034814856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034814856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:17.349260 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5038): Process ended prematurely: osmo-stp_10.42.42.5(pid=5038) [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5038)] [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py:19] 03:48:17.359454 tst emergency_mo_mt_call.py:19: Test FAILED (6.9 sec) 03:48:17.386493 run osmo-hlr_10.42.42.2(pid=5035): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5035)] 03:48:17.435113 run osmo-hlr_10.42.42.2(pid=5035): stdout: | (launched: 2022-12-14_03:48:13.638500) 03:48:17.485314 run osmo-hlr_10.42.42.2(pid=5035): stderr: | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034813838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034813851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034813859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034813859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034813859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:17.555080 run osmo-msc_10.42.42.6(pid=5041): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5041)] 03:48:17.603072 run osmo-msc_10.42.42.6(pid=5041): stdout: | (launched: 2022-12-14_03:48:15.867196) 03:48:17.653365 run osmo-msc_10.42.42.6(pid=5041): stderr: | [0;m[38;5;43m20221214034816637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034816637 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6607ffdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034816638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034816638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034816639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034816639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034816646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034816647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034816647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034816647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:17.703393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5034): Terminating (SIGTERM) 03:48:17.742983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5037): Terminating (SIGTERM) 03:48:17.782521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5040): Terminating (SIGTERM) 03:48:17.822449 --- ParallelTerminationStrategy: PID 5034 died... 03:48:17.841404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5034): Terminated: ok {rc=0} 03:48:17.885295 --- ParallelTerminationStrategy: PID 5037 died... 03:48:17.904046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5037): Terminated: ok {rc=0} 03:48:17.947848 --- ParallelTerminationStrategy: PID 5040 died... 03:48:17.966815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5040): Terminated: ok {rc=0} 03:48:18.051963 bus /sierra_3: Setting Powered False 03:48:19.151263 bus /sierra_3: Setting Powered False 03:48:20.265530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 03:48:21.353786 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.365816 tst emergency:oc2g: Using 1 x bts (candidates: 1) 03:48:21.404493 tst emergency_preemptive_call.py: using LAC 38335 03:48:21.524371 tst emergency_preemptive_call.py: using RAC 85 03:48:21.653926 tst emergency_preemptive_call.py: using CellId 38335 03:48:21.785176 tst emergency_preemptive_call.py: using BVCI 38336 03:48:21.904175 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.915517 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.926744 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.937889 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.949550 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 03:48:21.960801 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:22.078275 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:22.200930 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:22.319019 tst emergency:oc2g: Using 1 x modem (candidates: 4) 03:48:22.437912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:22.945663 run create_hlr_db(pid=5043): Launched 03:48:23.069552 bus /sierra_2: Setting Powered False 03:48:24.133941 run create_hlr_db(pid=5043): Terminated: ok {rc=0} 03:48:24.572257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5045): Launched 03:48:24.877303 run osmo-hlr_10.42.42.2(pid=5046): Launched 03:48:24.991997 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:25.516224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5048): Launched 03:48:25.820336 run osmo-stp_10.42.42.5(pid=5049): Launched 03:48:25.950759 tst emergency_preemptive_call.py: using MSISDN 8493 03:48:26.104253 run osmo-msc_10.42.42.6: Starting osmo-msc 03:48:26.650009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5051): Launched 03:48:26.953089 run osmo-msc_10.42.42.6(pid=5052): Launched 03:48:27.122193 run osmo-stp_10.42.42.5(pid=5049): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5049)] 03:48:27.249430 run osmo-stp_10.42.42.5(pid=5049): stdout: | (launched: 2022-12-14_03:48:25.761998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:27.377185 run osmo-stp_10.42.42.5(pid=5049): stderr: | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034825935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:27.502791 run osmo-stp_10.42.42.5(pid=5049): stdout: | (launched: 2022-12-14_03:48:25.761998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:27.622272 run osmo-stp_10.42.42.5(pid=5049): stderr: | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034825934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034825935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034825935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:27.765068 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5049): Process ended prematurely: osmo-stp_10.42.42.5(pid=5049) [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5049)] [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py:32] 03:48:27.773402 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 03:48:27.799352 run osmo-hlr_10.42.42.2(pid=5046): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5046)] 03:48:27.847334 run osmo-hlr_10.42.42.2(pid=5046): stdout: | (launched: 2022-12-14_03:48:24.819198) 03:48:27.896641 run osmo-hlr_10.42.42.2(pid=5046): stderr: | [0;m[1;31m20221214034824995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034824995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034824995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034824995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034824996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034824996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034825008 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034825017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034825017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034825017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:27.965332 run osmo-msc_10.42.42.6(pid=5052): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5052)] 03:48:28.012739 run osmo-msc_10.42.42.6(pid=5052): stdout: | (launched: 2022-12-14_03:48:26.894890) 03:48:28.061737 run osmo-msc_10.42.42.6(pid=5052): stderr: | [0;m[38;5;43m20221214034827168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214034827168 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcbabd6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214034827168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214034827168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214034827168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214034827169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214034827170 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214034827171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214034827171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214034827171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:48:28.111270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5045): Terminating (SIGTERM) 03:48:28.150465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5048): Terminating (SIGTERM) 03:48:28.189761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5051): Terminating (SIGTERM) 03:48:28.229322 --- ParallelTerminationStrategy: PID 5045 died... 03:48:28.247661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5045): Terminated: ok {rc=0} 03:48:28.291372 --- ParallelTerminationStrategy: PID 5048 died... 03:48:28.309738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5048): Terminated: ok {rc=0} 03:48:28.353856 --- ParallelTerminationStrategy: PID 5051 died... 03:48:28.372681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5051): Terminated: ok {rc=0} 03:48:28.459266 bus /sierra_9: Setting Powered False 03:48:29.559983 bus /sierra_9: Setting Powered False 03:48:30.677217 bus /sierra_8: Setting Powered False 03:48:31.786414 bus /sierra_8: Setting Powered False 03:48:32.918435 bus /sierra_3: Setting Powered False 03:48:34.021018 bus /sierra_3: Setting Powered False 03:48:35.138549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:oc2g --------------------------------------------------------------------- 03:48:36.400777 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:48:36.405057 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 03:48:36.425364 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 03:48:36.464920 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 03:48:36.552007 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 03:48:36.572448 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 03:48:36.611155 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 03:48:37.203185 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 03:48:37.255341 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.265967 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:37.300599 tst cs_paging_gprs_active.py: using LAC 38336 03:48:37.421184 tst cs_paging_gprs_active.py: using RAC 86 03:48:37.540894 tst cs_paging_gprs_active.py: using CellId 38336 03:48:37.660010 tst cs_paging_gprs_active.py: using BVCI 38337 03:48:37.772209 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.782665 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.792898 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.803253 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.813459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.824001 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.834765 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.845422 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:37.856148 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:37.972453 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:38.093453 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:48:38.317283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:38.652114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5057): Launched 03:48:38.942257 run iperf3-srv_10.42.42.10(pid=5058): Launched 03:48:39.067032 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:48:39.290725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:39.625115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Launched 03:48:39.915745 run iperf3-srv_10.42.42.10(pid=5060): Launched 03:48:40.040452 tst cs_paging_gprs_active.py:38: start network... 03:48:40.264259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:40.781191 run create_hlr_db(pid=5061): Launched 03:48:40.908517 bus /sierra_2: Setting Powered False 03:48:41.973822 run create_hlr_db(pid=5061): Terminated: ok {rc=0} 03:48:42.414906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5063): Launched 03:48:42.725461 run osmo-hlr_10.42.42.2(pid=5064): Launched 03:48:42.842991 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:43.393495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5066): Launched 03:48:43.704065 run osmo-stp_10.42.42.5(pid=5067): Launched 03:48:43.821624 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:44.353858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5069): Launched 03:48:44.470987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:44.734221 run patchelf(pid=5070): Launched 03:48:44.905144 run osmo-stp_10.42.42.5(pid=5067): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5067)] 03:48:45.035148 run osmo-stp_10.42.42.5(pid=5067): stdout: | (launched: 2022-12-14_03:48:43.644672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:45.166776 run osmo-stp_10.42.42.5(pid=5067): stderr: | [0;m[38;5;43m20221214034843820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034843820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034843821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034843821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:45.298284 run osmo-stp_10.42.42.5(pid=5067): stdout: | (launched: 2022-12-14_03:48:43.644672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:45.423998 run osmo-stp_10.42.42.5(pid=5067): stderr: | [0;m[38;5;43m20221214034843820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034843820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034843821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034843821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034843822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:45.573326 run patchelf(pid=5070): Terminating (SIGINT) 03:48:45.746029 run patchelf(pid=5070): Terminated: ok {rc=0} 03:48:45.879707 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5067): Process ended prematurely: osmo-stp_10.42.42.5(pid=5067) [trial-2399↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5067)] [trial-2399↪gprs:oc2g↪cs_paging_gprs_active.py:38] 03:48:45.890537 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:48:45.925548 run osmo-hlr_10.42.42.2(pid=5064): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5064)] 03:48:45.974511 run osmo-hlr_10.42.42.2(pid=5064): stdout: | (launched: 2022-12-14_03:48:42.666634) 03:48:46.025902 run osmo-hlr_10.42.42.2(pid=5064): stderr: | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034842847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034842860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034842870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034842870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034842870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:46.077196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5057): Terminating (SIGTERM) 03:48:46.118484 run iperf3-srv_10.42.42.10(pid=5058): Terminating (SIGTERM) 03:48:46.163143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Terminating (SIGTERM) 03:48:46.205785 run iperf3-srv_10.42.42.10(pid=5060): Terminating (SIGTERM) 03:48:46.251436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5063): Terminating (SIGTERM) 03:48:46.293616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5066): Terminating (SIGTERM) 03:48:46.337664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5069): Terminating (SIGTERM) 03:48:46.379683 --- ParallelTerminationStrategy: PID 5057 died... 03:48:46.399295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5057): Terminated: ok {rc=0} 03:48:46.446264 --- ParallelTerminationStrategy: PID 5058 died... 03:48:46.466965 run iperf3-srv_10.42.42.10(pid=5058): Terminated {rc=256} 03:48:46.512326 --- ParallelTerminationStrategy: PID 5059 died... 03:48:46.533009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5059): Terminated: ok {rc=0} 03:48:46.578649 --- ParallelTerminationStrategy: PID 5060 died... 03:48:46.597903 run iperf3-srv_10.42.42.10(pid=5060): Terminated {rc=256} 03:48:46.643966 --- ParallelTerminationStrategy: PID 5063 died... 03:48:46.663190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5063): Terminated: ok {rc=0} 03:48:46.708234 --- ParallelTerminationStrategy: PID 5066 died... 03:48:46.728056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5066): Terminated: ok {rc=0} 03:48:46.772593 --- ParallelTerminationStrategy: PID 5069 died... 03:48:46.791968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5069): Terminated: ok {rc=0} 03:48:46.876521 bus /gobi_0: Setting Powered False 03:48:47.973783 bus /gobi_0: Setting Powered False 03:48:49.088021 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g iperf3.py ---------------------------------------------- 03:48:50.240937 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.252807 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:48:50.290285 tst iperf3.py: using LAC 38337 03:48:50.412219 tst iperf3.py: using RAC 87 03:48:50.534669 tst iperf3.py: using CellId 38337 03:48:50.657364 tst iperf3.py: using BVCI 38338 03:48:50.770211 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.780698 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.791144 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.801557 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.811774 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.822012 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.832407 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.843106 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:48:50.853998 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:48:50.974486 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:48:51.198510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:48:51.533964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5071): Launched 03:48:51.827345 run iperf3-srv_10.42.42.10(pid=5072): Launched 03:48:51.954347 tst iperf3.py:8: start network... 03:48:52.178001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:48:52.696764 run create_hlr_db(pid=5073): Launched 03:48:52.824173 bus /gobi_6: Setting Powered False 03:48:53.890017 run create_hlr_db(pid=5073): Terminated: ok {rc=0} 03:48:54.352745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5075): Launched 03:48:54.687243 run osmo-hlr_10.42.42.2(pid=5076): Launched 03:48:54.817165 run osmo-stp_10.42.42.5: Starting osmo-stp 03:48:55.393869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5078): Launched 03:48:55.728723 run osmo-stp_10.42.42.5(pid=5079): Launched 03:48:55.855968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:48:56.431132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5081): Launched 03:48:56.559057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:48:56.842060 run patchelf(pid=5082): Launched 03:48:57.026404 run osmo-stp_10.42.42.5(pid=5079): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5079)] 03:48:57.167056 run osmo-stp_10.42.42.5(pid=5079): stdout: | (launched: 2022-12-14_03:48:55.666531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:57.316718 run osmo-stp_10.42.42.5(pid=5079): stderr: | [0;m[38;5;43m20221214034855863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034855863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034855864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034855864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:57.455748 run osmo-stp_10.42.42.5(pid=5079): stdout: | (launched: 2022-12-14_03:48:55.666531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:48:57.589936 run osmo-stp_10.42.42.5(pid=5079): stderr: | [0;m[38;5;43m20221214034855863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034855863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034855864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034855864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034855865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:48:57.747966 run patchelf(pid=5082): Terminating (SIGINT) 03:48:57.929356 run patchelf(pid=5082): Terminated: ok {rc=0} 03:48:58.060257 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5079): Process ended prematurely: osmo-stp_10.42.42.5(pid=5079) [trial-2399↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5079)] [trial-2399↪gprs:oc2g↪iperf3.py:8] 03:48:58.070471 tst iperf3.py:8: Test FAILED (7.9 sec) 03:48:58.099379 run osmo-hlr_10.42.42.2(pid=5076): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5076)] 03:48:58.150688 run osmo-hlr_10.42.42.2(pid=5076): stdout: | (launched: 2022-12-14_03:48:54.624407) 03:48:58.203630 run osmo-hlr_10.42.42.2(pid=5076): stderr: | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034854828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034854841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034854849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034854849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034854849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:48:58.256688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5071): Terminating (SIGTERM) 03:48:58.298627 run iperf3-srv_10.42.42.10(pid=5072): Terminating (SIGTERM) 03:48:58.341164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5075): Terminating (SIGTERM) 03:48:58.383820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5078): Terminating (SIGTERM) 03:48:58.426376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5081): Terminating (SIGTERM) 03:48:58.469211 --- ParallelTerminationStrategy: PID 5071 died... 03:48:58.490069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5071): Terminated: ok {rc=0} 03:48:58.537422 --- ParallelTerminationStrategy: PID 5072 died... 03:48:58.557620 run iperf3-srv_10.42.42.10(pid=5072): Terminated {rc=256} 03:48:58.604417 --- ParallelTerminationStrategy: PID 5075 died... 03:48:58.624667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5075): Terminated: ok {rc=0} 03:48:58.671597 --- ParallelTerminationStrategy: PID 5078 died... 03:48:58.691792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5078): Terminated: ok {rc=0} 03:48:58.739248 --- ParallelTerminationStrategy: PID 5081 died... 03:48:58.759532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5081): Terminated: ok {rc=0} 03:48:58.847967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g iperf3m4.py ---------------------------------------------- 03:48:59.998820 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.010612 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:00.051087 tst iperf3m4.py: using LAC 38338 03:49:00.179213 tst iperf3m4.py: using RAC 88 03:49:00.310021 tst iperf3m4.py: using CellId 38338 03:49:00.437594 tst iperf3m4.py: using BVCI 38339 03:49:00.547487 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.558081 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.568386 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.578720 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.589366 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.600153 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.610531 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.620807 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:00.631178 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:00.746137 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:00.876166 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:01.026673 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:01.146858 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:01.370139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:01.704374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5083): Launched 03:49:02.036377 run iperf3-srv_10.42.42.10(pid=5084): Launched 03:49:02.160247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:49:02.365839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:02.671547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Launched 03:49:02.936220 run iperf3-srv_10.42.42.10(pid=5086): Launched 03:49:03.049829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:49:03.250592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:03.555479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Launched 03:49:03.819593 run iperf3-srv_10.42.42.10(pid=5088): Launched 03:49:03.932473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:49:04.133036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:04.457245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Launched 03:49:04.742413 run iperf3-srv_10.42.42.10(pid=5090): Launched 03:49:04.865655 tst iperf3m4.py:8: start network... 03:49:05.084374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:05.591859 run create_hlr_db(pid=5091): Launched 03:49:05.715768 bus /gobi_6: Setting Powered False 03:49:06.780784 run create_hlr_db(pid=5091): Terminated: ok {rc=0} 03:49:07.234971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Launched 03:49:07.562866 run osmo-hlr_10.42.42.2(pid=5094): Launched 03:49:07.687802 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:08.249791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Launched 03:49:08.577471 run osmo-stp_10.42.42.5(pid=5097): Launched 03:49:08.702985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:09.269623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Launched 03:49:09.394466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:09.673206 run patchelf(pid=5100): Launched 03:49:09.854597 run osmo-stp_10.42.42.5(pid=5097): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] 03:49:09.992334 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-14_03:49:08.515790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:10.131678 run osmo-stp_10.42.42.5(pid=5097): stderr: | [0;m[38;5;43m20221214034908709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034908709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034908710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034908710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034908712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034908713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034908713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:10.271425 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-14_03:49:08.515790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:10.405243 run osmo-stp_10.42.42.5(pid=5097): stderr: | [0;m[38;5;43m20221214034908709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034908709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034908710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034908710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034908712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034908713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034908713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:10.564265 run patchelf(pid=5100): Terminating (SIGINT) 03:49:10.745885 run patchelf(pid=5100): Terminated: ok {rc=0} 03:49:10.877190 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2399↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] [trial-2399↪gprs:oc2g↪iperf3m4.py:8] 03:49:10.887318 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:49:10.916209 run osmo-hlr_10.42.42.2(pid=5094): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5094)] 03:49:10.967000 run osmo-hlr_10.42.42.2(pid=5094): stdout: | (launched: 2022-12-14_03:49:07.501266) 03:49:11.018872 run osmo-hlr_10.42.42.2(pid=5094): stderr: | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034907700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034907713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034907722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034907722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034907722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:11.071195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5083): Terminating (SIGTERM) 03:49:11.113061 run iperf3-srv_10.42.42.10(pid=5084): Terminating (SIGTERM) 03:49:11.154706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Terminating (SIGTERM) 03:49:11.196297 run iperf3-srv_10.42.42.10(pid=5086): Terminating (SIGTERM) 03:49:11.237811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Terminating (SIGTERM) 03:49:11.279602 run iperf3-srv_10.42.42.10(pid=5088): Terminating (SIGTERM) 03:49:11.321866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Terminating (SIGTERM) 03:49:11.364169 run iperf3-srv_10.42.42.10(pid=5090): Terminating (SIGTERM) 03:49:11.406176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminating (SIGTERM) 03:49:11.448637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminating (SIGTERM) 03:49:11.490813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminating (SIGTERM) 03:49:11.533527 --- ParallelTerminationStrategy: PID 5083 died... 03:49:11.553736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5083): Terminated: ok {rc=0} 03:49:11.600345 --- ParallelTerminationStrategy: PID 5084 died... 03:49:11.620292 run iperf3-srv_10.42.42.10(pid=5084): Terminated {rc=256} 03:49:11.666479 --- ParallelTerminationStrategy: PID 5085 died... 03:49:11.686622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5085): Terminated: ok {rc=0} 03:49:11.732664 --- ParallelTerminationStrategy: PID 5086 died... 03:49:11.752671 run iperf3-srv_10.42.42.10(pid=5086): Terminated {rc=256} 03:49:11.798690 --- ParallelTerminationStrategy: PID 5087 died... 03:49:11.818687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5087): Terminated: ok {rc=0} 03:49:11.864854 --- ParallelTerminationStrategy: PID 5088 died... 03:49:11.885289 run iperf3-srv_10.42.42.10(pid=5088): Terminated {rc=256} 03:49:11.931527 --- ParallelTerminationStrategy: PID 5089 died... 03:49:11.951500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5089): Terminated: ok {rc=0} 03:49:11.997505 --- ParallelTerminationStrategy: PID 5090 died... 03:49:12.017443 run iperf3-srv_10.42.42.10(pid=5090): Terminated {rc=256} 03:49:12.063635 --- ParallelTerminationStrategy: PID 5093 died... 03:49:12.083644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminated: ok {rc=0} 03:49:12.130048 --- ParallelTerminationStrategy: PID 5096 died... 03:49:12.150239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminated: ok {rc=0} 03:49:12.196549 --- ParallelTerminationStrategy: PID 5099 died... 03:49:12.216549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminated: ok {rc=0} 03:49:12.303591 bus /gobi_4: Setting Powered False 03:49:13.402041 bus /gobi_4: Setting Powered False 03:49:14.515089 bus /gobi_1: Setting Powered False 03:49:15.612941 bus /gobi_1: Setting Powered False 03:49:16.730208 bus /gobi_0: Setting Powered False 03:49:17.832562 bus /gobi_0: Setting Powered False 03:49:18.947369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g ping.py ---------------------------------------------- 03:49:20.048513 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.059659 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:20.094856 tst ping.py: using LAC 38339 03:49:20.220803 tst ping.py: using RAC 89 03:49:20.345813 tst ping.py: using CellId 38339 03:49:20.477106 tst ping.py: using BVCI 38340 03:49:20.595702 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.606640 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.617337 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.627962 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.638911 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.649792 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.660804 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:20.671886 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:20.790599 tst ping.py:19: start network... 03:49:21.004763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:21.497990 run create_hlr_db(pid=5101): Launched 03:49:21.618794 bus /gobi_6: Setting Powered False 03:49:22.682067 run create_hlr_db(pid=5101): Terminated: ok {rc=0} 03:49:23.126866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5103): Launched 03:49:23.447155 run osmo-hlr_10.42.42.2(pid=5104): Launched 03:49:23.568917 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:24.118958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5106): Launched 03:49:24.439457 run osmo-stp_10.42.42.5(pid=5107): Launched 03:49:24.561819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:25.116435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5109): Launched 03:49:25.238881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:25.510689 run patchelf(pid=5110): Launched 03:49:25.688630 run osmo-stp_10.42.42.5(pid=5107): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5107)] 03:49:25.823860 run osmo-stp_10.42.42.5(pid=5107): stdout: | (launched: 2022-12-14_03:49:24.379401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:25.961401 run osmo-stp_10.42.42.5(pid=5107): stderr: | [0;m[38;5;43m20221214034924572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034924573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034924573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034924573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:26.099050 run osmo-stp_10.42.42.5(pid=5107): stdout: | (launched: 2022-12-14_03:49:24.379401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:26.230038 run osmo-stp_10.42.42.5(pid=5107): stderr: | [0;m[38;5;43m20221214034924572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034924573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034924573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034924573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034924574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:26.385624 run patchelf(pid=5110): Terminating (SIGINT) 03:49:26.565180 run patchelf(pid=5110): Terminated: ok {rc=0} 03:49:26.694099 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5107): Process ended prematurely: osmo-stp_10.42.42.5(pid=5107) [trial-2399↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5107)] [trial-2399↪gprs:oc2g↪ping.py:22] 03:49:26.703717 tst ping.py:22: Test FAILED (6.6 sec) 03:49:26.732188 run osmo-hlr_10.42.42.2(pid=5104): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5104)] 03:49:26.783510 run osmo-hlr_10.42.42.2(pid=5104): stdout: | (launched: 2022-12-14_03:49:23.386965) 03:49:26.836686 run osmo-hlr_10.42.42.2(pid=5104): stderr: | [0;m[1;31m20221214034923586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034923586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034923586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034923586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034923587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034923587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034923599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034923607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:26.889661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5103): Terminating (SIGTERM) 03:49:26.931944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5106): Terminating (SIGTERM) 03:49:26.974979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5109): Terminating (SIGTERM) 03:49:27.017850 --- ParallelTerminationStrategy: PID 5103 died... 03:49:27.038557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5103): Terminated: ok {rc=0} 03:49:27.085787 --- ParallelTerminationStrategy: PID 5106 died... 03:49:27.105983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5106): Terminated: ok {rc=0} 03:49:27.152757 --- ParallelTerminationStrategy: PID 5109 died... 03:49:27.172848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5109): Terminated: ok {rc=0} 03:49:27.261637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 03:49:28.351042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.362902 tst gprs:oc2g: Using 1 x bts (candidates: 1) 03:49:28.399632 tst ping_idle_ping.py: using LAC 38340 03:49:28.516783 tst ping_idle_ping.py: using RAC 90 03:49:28.643750 tst ping_idle_ping.py: using CellId 38340 03:49:28.770939 tst ping_idle_ping.py: using BVCI 38341 03:49:28.887986 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.899049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.910116 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.921127 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.932502 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.943946 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.955609 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 03:49:28.967306 tst gprs:oc2g: Using 1 x modem (candidates: 4) 03:49:29.083686 tst ping_idle_ping.py:24: start network... 03:49:29.281152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:29.744362 run create_hlr_db(pid=5111): Launched 03:49:29.866548 bus /gobi_6: Setting Powered False 03:49:30.936639 run create_hlr_db(pid=5111): Terminated: ok {rc=0} 03:49:31.427363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5113): Launched 03:49:31.873124 run osmo-hlr_10.42.42.2(pid=5114): Launched 03:49:32.036862 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:32.779134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5116): Launched 03:49:33.101518 run osmo-stp_10.42.42.5(pid=5117): Launched 03:49:33.224171 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:33.779126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5119): Launched 03:49:33.901984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:34.174027 run patchelf(pid=5120): Launched 03:49:34.351951 run osmo-stp_10.42.42.5(pid=5117): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5117)] 03:49:34.487885 run osmo-stp_10.42.42.5(pid=5117): stdout: | (launched: 2022-12-14_03:49:33.041241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:34.626573 run osmo-stp_10.42.42.5(pid=5117): stderr: | [0;m[38;5;43m20221214034933236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034933237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034933237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034933237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:34.764485 run osmo-stp_10.42.42.5(pid=5117): stdout: | (launched: 2022-12-14_03:49:33.041241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:34.895994 run osmo-stp_10.42.42.5(pid=5117): stderr: | [0;m[38;5;43m20221214034933236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034933237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034933237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034933237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034933238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:35.051995 run patchelf(pid=5120): Terminating (SIGINT) 03:49:35.231375 run patchelf(pid=5120): Terminated: ok {rc=0} 03:49:35.360686 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5117): Process ended prematurely: osmo-stp_10.42.42.5(pid=5117) [trial-2399↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5117)] [trial-2399↪gprs:oc2g↪ping_idle_ping.py:27] 03:49:35.370325 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 03:49:35.398717 run osmo-hlr_10.42.42.2(pid=5114): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5114)] 03:49:35.449950 run osmo-hlr_10.42.42.2(pid=5114): stdout: | (launched: 2022-12-14_03:49:31.789680) 03:49:35.502307 run osmo-hlr_10.42.42.2(pid=5114): stderr: | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034932198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034932215 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034932224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034932224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034932224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:35.555962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5113): Terminating (SIGTERM) 03:49:35.597863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5116): Terminating (SIGTERM) 03:49:35.639923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5119): Terminating (SIGTERM) 03:49:35.682978 --- ParallelTerminationStrategy: PID 5113 died... 03:49:35.703319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5113): Terminated: ok {rc=0} 03:49:35.749873 --- ParallelTerminationStrategy: PID 5116 died... 03:49:35.769757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5116): Terminated: ok {rc=0} 03:49:35.816233 --- ParallelTerminationStrategy: PID 5119 died... 03:49:35.836252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5119): Terminated: ok {rc=0} 03:49:35.924487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 03:49:37.214888 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:49:37.220342 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:49:37.241536 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:49:37.281121 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:49:37.369821 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:49:37.390450 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:49:37.429386 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:49:38.022891 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:49:38.073985 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.084797 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:38.121589 tst cs_paging_gprs_active.py: using LAC 38341 03:49:38.274616 tst cs_paging_gprs_active.py: using RAC 91 03:49:38.398219 tst cs_paging_gprs_active.py: using CellId 38341 03:49:38.521347 tst cs_paging_gprs_active.py: using BVCI 38342 03:49:38.634781 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.645804 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.656481 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.667214 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.678395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.689370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.700489 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.711481 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:38.722690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:38.839380 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:38.954524 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:49:39.165506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:39.478122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5125): Launched 03:49:39.749301 run iperf3-srv_10.42.42.10(pid=5126): Launched 03:49:39.866124 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:49:40.075979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:40.388571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5127): Launched 03:49:40.660312 run iperf3-srv_10.42.42.10(pid=5128): Launched 03:49:40.777431 tst cs_paging_gprs_active.py:38: start network... 03:49:40.986879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:41.472374 run create_hlr_db(pid=5129): Launched 03:49:41.591703 bus /gobi_6: Setting Powered False 03:49:42.654761 run create_hlr_db(pid=5129): Terminated: ok {rc=0} 03:49:43.091104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5131): Launched 03:49:43.403673 run osmo-hlr_10.42.42.2(pid=5132): Launched 03:49:43.522840 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:44.026606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5134): Launched 03:49:44.317153 run osmo-stp_10.42.42.5(pid=5135): Launched 03:49:44.427540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:44.929298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5137): Launched 03:49:45.040590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:45.286962 run patchelf(pid=5138): Launched 03:49:45.451013 run osmo-stp_10.42.42.5(pid=5135): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5135)] 03:49:45.575892 run osmo-stp_10.42.42.5(pid=5135): stdout: | (launched: 2022-12-14_03:49:44.263995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:45.701885 run osmo-stp_10.42.42.5(pid=5135): stderr: | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034944430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:45.828094 run osmo-stp_10.42.42.5(pid=5135): stdout: | (launched: 2022-12-14_03:49:44.263995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:45.994278 run osmo-stp_10.42.42.5(pid=5135): stderr: | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034944429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034944430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034944430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:46.153780 run patchelf(pid=5138): Terminating (SIGINT) 03:49:46.336475 run patchelf(pid=5138): Terminated: ok {rc=0} 03:49:46.469313 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5135): Process ended prematurely: osmo-stp_10.42.42.5(pid=5135) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5135)] [trial-2399↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:49:46.480519 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:49:46.510718 run osmo-hlr_10.42.42.2(pid=5132): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5132)] 03:49:46.566013 run osmo-hlr_10.42.42.2(pid=5132): stdout: | (launched: 2022-12-14_03:49:43.346973) 03:49:46.621735 run osmo-hlr_10.42.42.2(pid=5132): stderr: | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034943537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034943550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034943558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034943558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034943558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:46.677667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5125): Terminating (SIGTERM) 03:49:46.721916 run iperf3-srv_10.42.42.10(pid=5126): Terminating (SIGTERM) 03:49:46.766412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5127): Terminating (SIGTERM) 03:49:46.810835 run iperf3-srv_10.42.42.10(pid=5128): Terminating (SIGTERM) 03:49:46.856303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5131): Terminating (SIGTERM) 03:49:46.901186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5134): Terminating (SIGTERM) 03:49:46.946963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5137): Terminating (SIGTERM) 03:49:46.993554 --- ParallelTerminationStrategy: PID 5125 died... 03:49:47.015615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5125): Terminated: ok {rc=0} 03:49:47.065481 --- ParallelTerminationStrategy: PID 5126 died... 03:49:47.086848 run iperf3-srv_10.42.42.10(pid=5126): Terminated {rc=256} 03:49:47.137004 --- ParallelTerminationStrategy: PID 5127 died... 03:49:47.158402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5127): Terminated: ok {rc=0} 03:49:47.207404 --- ParallelTerminationStrategy: PID 5128 died... 03:49:47.228162 run iperf3-srv_10.42.42.10(pid=5128): Terminated {rc=256} 03:49:47.275038 --- ParallelTerminationStrategy: PID 5131 died... 03:49:47.295305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5131): Terminated: ok {rc=0} 03:49:47.342305 --- ParallelTerminationStrategy: PID 5134 died... 03:49:47.362839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5134): Terminated: ok {rc=0} 03:49:47.410014 --- ParallelTerminationStrategy: PID 5137 died... 03:49:47.430445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5137): Terminated: ok {rc=0} 03:49:47.519722 bus /gobi_0: Setting Powered False 03:49:48.618467 bus /gobi_0: Setting Powered False 03:49:49.733770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:49:50.881744 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:50.893410 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:49:50.930879 tst iperf3.py: using LAC 38342 03:49:51.054420 tst iperf3.py: using RAC 92 03:49:51.178006 tst iperf3.py: using CellId 38342 03:49:51.302872 tst iperf3.py: using BVCI 38343 03:49:51.419378 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.430375 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.441283 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.452078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.463172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.474300 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.485654 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.496729 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:51.507943 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:49:51.624906 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:49:51.820684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:49:52.115806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5139): Launched 03:49:52.371099 run iperf3-srv_10.42.42.10(pid=5140): Launched 03:49:52.481505 tst iperf3.py:8: start network... 03:49:52.676700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:49:53.131126 run create_hlr_db(pid=5141): Launched 03:49:53.252129 bus /gobi_6: Setting Powered False 03:49:54.310584 run create_hlr_db(pid=5141): Terminated: ok {rc=0} 03:49:54.741650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5143): Launched 03:49:55.056817 run osmo-hlr_10.42.42.2(pid=5144): Launched 03:49:55.176513 run osmo-stp_10.42.42.5: Starting osmo-stp 03:49:55.722636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5146): Launched 03:49:56.017544 run osmo-stp_10.42.42.5(pid=5147): Launched 03:49:56.129788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:49:56.634146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5149): Launched 03:49:56.745737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:49:56.992716 run patchelf(pid=5150): Launched 03:49:57.156162 run osmo-stp_10.42.42.5(pid=5147): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5147)] 03:49:57.280675 run osmo-stp_10.42.42.5(pid=5147): stdout: | (launched: 2022-12-14_03:49:55.963805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:57.406252 run osmo-stp_10.42.42.5(pid=5147): stderr: | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034956129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:57.531961 run osmo-stp_10.42.42.5(pid=5147): stdout: | (launched: 2022-12-14_03:49:55.963805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:49:57.652087 run osmo-stp_10.42.42.5(pid=5147): stderr: | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214034956128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214034956129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214034956129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:49:57.794290 run patchelf(pid=5150): Terminating (SIGINT) 03:49:57.958058 run patchelf(pid=5150): Terminated: ok {rc=0} 03:49:58.076287 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5147): Process ended prematurely: osmo-stp_10.42.42.5(pid=5147) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5147)] [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 03:49:58.085690 tst iperf3.py:8: Test FAILED (7.2 sec) 03:49:58.112265 run osmo-hlr_10.42.42.2(pid=5144): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5144)] 03:49:58.159159 run osmo-hlr_10.42.42.2(pid=5144): stdout: | (launched: 2022-12-14_03:49:54.999210) 03:49:58.207836 run osmo-hlr_10.42.42.2(pid=5144): stderr: | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214034955192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214034955204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214034955212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214034955213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214034955213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:49:58.257325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5139): Terminating (SIGTERM) 03:49:58.296797 run iperf3-srv_10.42.42.10(pid=5140): Terminating (SIGTERM) 03:49:58.335983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5143): Terminating (SIGTERM) 03:49:58.375451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5146): Terminating (SIGTERM) 03:49:58.414769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5149): Terminating (SIGTERM) 03:49:58.454322 --- ParallelTerminationStrategy: PID 5139 died... 03:49:58.473159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5139): Terminated: ok {rc=0} 03:49:58.516614 --- ParallelTerminationStrategy: PID 5140 died... 03:49:58.535079 run iperf3-srv_10.42.42.10(pid=5140): Terminated {rc=256} 03:49:58.578406 --- ParallelTerminationStrategy: PID 5143 died... 03:49:58.596813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5143): Terminated: ok {rc=0} 03:49:58.640148 --- ParallelTerminationStrategy: PID 5146 died... 03:49:58.658619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5146): Terminated: ok {rc=0} 03:49:58.702735 --- ParallelTerminationStrategy: PID 5149 died... 03:49:58.721448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5149): Terminated: ok {rc=0} 03:49:58.807550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:49:59.952197 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:49:59.963533 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:00.000635 tst iperf3m4.py: using LAC 38343 03:50:00.117381 tst iperf3m4.py: using RAC 93 03:50:00.232743 tst iperf3m4.py: using CellId 38343 03:50:00.348225 tst iperf3m4.py: using BVCI 38344 03:50:00.456152 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.466768 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.477250 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.487674 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.497975 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.508170 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.518701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.529514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:00.540583 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:00.660764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:00.778179 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:00.919725 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:01.041881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:01.244571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:01.575089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Launched 03:50:01.848501 run iperf3-srv_10.42.42.10(pid=5155): Launched 03:50:01.975985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:50:02.175421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:02.471955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Launched 03:50:02.728295 run iperf3-srv_10.42.42.10(pid=5157): Launched 03:50:02.838735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:50:03.032659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:03.327273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Launched 03:50:03.581707 run iperf3-srv_10.42.42.10(pid=5159): Launched 03:50:03.691907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:50:03.887146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:04.182176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5160): Launched 03:50:04.437642 run iperf3-srv_10.42.42.10(pid=5161): Launched 03:50:04.547538 tst iperf3m4.py:8: start network... 03:50:04.742145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:05.197830 run create_hlr_db(pid=5162): Launched 03:50:05.318230 bus /gobi_6: Setting Powered False 03:50:06.377203 run create_hlr_db(pid=5162): Terminated: ok {rc=0} 03:50:06.785546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5164): Launched 03:50:07.079947 run osmo-hlr_10.42.42.2(pid=5165): Launched 03:50:07.191154 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:07.712224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5167): Launched 03:50:08.006573 run osmo-stp_10.42.42.5(pid=5168): Launched 03:50:08.119496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:08.632515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5170): Launched 03:50:08.746894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:08.997820 run patchelf(pid=5171): Launched 03:50:09.163266 run osmo-stp_10.42.42.5(pid=5168): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5168)] 03:50:09.290029 run osmo-stp_10.42.42.5(pid=5168): stdout: | (launched: 2022-12-14_03:50:07.952271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:09.417602 run osmo-stp_10.42.42.5(pid=5168): stderr: | [0;m[38;5;43m20221214035008116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035008117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035008117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035008117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:09.545478 run osmo-stp_10.42.42.5(pid=5168): stdout: | (launched: 2022-12-14_03:50:07.952271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:09.667788 run osmo-stp_10.42.42.5(pid=5168): stderr: | [0;m[38;5;43m20221214035008116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035008117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035008117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035008117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035008119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:09.812134 run patchelf(pid=5171): Terminating (SIGINT) 03:50:09.978728 run patchelf(pid=5171): Terminated: ok {rc=0} 03:50:10.099197 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5168): Process ended prematurely: osmo-stp_10.42.42.5(pid=5168) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5168)] [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 03:50:10.108619 tst iperf3m4.py:8: Test FAILED (10.2 sec) 03:50:10.135847 run osmo-hlr_10.42.42.2(pid=5165): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5165)] 03:50:10.183691 run osmo-hlr_10.42.42.2(pid=5165): stdout: | (launched: 2022-12-14_03:50:07.025237) 03:50:10.233108 run osmo-hlr_10.42.42.2(pid=5165): stderr: | [0;m[1;31m20221214035007196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035007197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035007197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035007197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035007197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035007197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035007209 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035007219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035007219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035007220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:10.282967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Terminating (SIGTERM) 03:50:10.322758 run iperf3-srv_10.42.42.10(pid=5155): Terminating (SIGTERM) 03:50:10.362279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Terminating (SIGTERM) 03:50:10.401864 run iperf3-srv_10.42.42.10(pid=5157): Terminating (SIGTERM) 03:50:10.441389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Terminating (SIGTERM) 03:50:10.481217 run iperf3-srv_10.42.42.10(pid=5159): Terminating (SIGTERM) 03:50:10.520789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5160): Terminating (SIGTERM) 03:50:10.560612 run iperf3-srv_10.42.42.10(pid=5161): Terminating (SIGTERM) 03:50:10.600209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5164): Terminating (SIGTERM) 03:50:10.639776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5167): Terminating (SIGTERM) 03:50:10.679302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5170): Terminating (SIGTERM) 03:50:10.719314 --- ParallelTerminationStrategy: PID 5154 died... 03:50:10.738309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5154): Terminated: ok {rc=0} 03:50:10.782558 --- ParallelTerminationStrategy: PID 5155 died... 03:50:10.801121 run iperf3-srv_10.42.42.10(pid=5155): Terminated {rc=256} 03:50:10.845113 --- ParallelTerminationStrategy: PID 5156 died... 03:50:10.863713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5156): Terminated: ok {rc=0} 03:50:10.907455 --- ParallelTerminationStrategy: PID 5157 died... 03:50:10.926001 run iperf3-srv_10.42.42.10(pid=5157): Terminated {rc=256} 03:50:10.969739 --- ParallelTerminationStrategy: PID 5158 died... 03:50:10.988494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5158): Terminated: ok {rc=0} 03:50:11.032369 --- ParallelTerminationStrategy: PID 5159 died... 03:50:11.050960 run iperf3-srv_10.42.42.10(pid=5159): Terminated {rc=256} 03:50:11.094873 --- ParallelTerminationStrategy: PID 5160 died... 03:50:11.113490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5160): Terminated: ok {rc=0} 03:50:11.157373 --- ParallelTerminationStrategy: PID 5161 died... 03:50:11.176078 run iperf3-srv_10.42.42.10(pid=5161): Terminated {rc=256} 03:50:11.219863 --- ParallelTerminationStrategy: PID 5164 died... 03:50:11.238443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5164): Terminated: ok {rc=0} 03:50:11.282678 --- ParallelTerminationStrategy: PID 5167 died... 03:50:11.301454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5167): Terminated: ok {rc=0} 03:50:11.345235 --- ParallelTerminationStrategy: PID 5170 died... 03:50:11.363859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5170): Terminated: ok {rc=0} 03:50:11.450153 bus /gobi_4: Setting Powered False 03:50:12.549549 bus /gobi_4: Setting Powered False 03:50:13.663894 bus /gobi_1: Setting Powered False 03:50:14.761563 bus /gobi_1: Setting Powered False 03:50:15.886614 bus /gobi_0: Setting Powered False 03:50:16.990185 bus /gobi_0: Setting Powered False 03:50:18.123989 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 03:50:19.223312 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.234652 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:19.270992 tst ping.py: using LAC 38344 03:50:19.385482 tst ping.py: using RAC 94 03:50:19.499543 tst ping.py: using CellId 38344 03:50:19.615430 tst ping.py: using BVCI 38345 03:50:19.720519 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.731243 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.741843 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.752377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.762799 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.773244 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.783715 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:19.794206 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:19.913186 tst ping.py:19: start network... 03:50:20.122400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:20.606686 run create_hlr_db(pid=5172): Launched 03:50:20.725754 bus /gobi_6: Setting Powered False 03:50:21.787770 run create_hlr_db(pid=5172): Terminated: ok {rc=0} 03:50:22.206375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Launched 03:50:22.499678 run osmo-hlr_10.42.42.2(pid=5175): Launched 03:50:22.611351 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:23.115440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Launched 03:50:23.407583 run osmo-stp_10.42.42.5(pid=5178): Launched 03:50:23.517689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:24.021631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Launched 03:50:24.133594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:24.380227 run patchelf(pid=5181): Launched 03:50:24.543036 run osmo-stp_10.42.42.5(pid=5178): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] 03:50:24.666907 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-14_03:50:23.352607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:24.792790 run osmo-stp_10.42.42.5(pid=5178): stderr: | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035023523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:24.918765 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-14_03:50:23.352607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:25.038602 run osmo-stp_10.42.42.5(pid=5178): stderr: | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035023522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035023523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035023523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:25.180784 run patchelf(pid=5181): Terminating (SIGINT) 03:50:25.345238 run patchelf(pid=5181): Terminated: ok {rc=0} 03:50:25.463916 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 03:50:25.472773 tst ping.py:22: Test FAILED (6.2 sec) 03:50:25.499417 run osmo-hlr_10.42.42.2(pid=5175): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5175)] 03:50:25.547240 run osmo-hlr_10.42.42.2(pid=5175): stdout: | (launched: 2022-12-14_03:50:22.444316) 03:50:25.597283 run osmo-hlr_10.42.42.2(pid=5175): stderr: | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035022617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035022630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035022640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035022640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035022640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:25.647092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Terminating (SIGTERM) 03:50:25.687028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminating (SIGTERM) 03:50:25.726732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Terminating (SIGTERM) 03:50:25.766608 --- ParallelTerminationStrategy: PID 5174 died... 03:50:25.785605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5174): Terminated: ok {rc=0} 03:50:25.829628 --- ParallelTerminationStrategy: PID 5177 died... 03:50:25.848092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminated: ok {rc=0} 03:50:25.892002 --- ParallelTerminationStrategy: PID 5180 died... 03:50:25.910521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5180): Terminated: ok {rc=0} 03:50:25.995993 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:50:27.084425 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.095893 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:50:27.136492 tst ping_idle_ping.py: using LAC 38345 03:50:27.260379 tst ping_idle_ping.py: using RAC 95 03:50:27.383087 tst ping_idle_ping.py: using CellId 38345 03:50:27.506785 tst ping_idle_ping.py: using BVCI 38346 03:50:27.622334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.633598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.644638 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.655798 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.667387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.679026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.691086 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:50:27.702926 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:50:27.820182 tst ping_idle_ping.py:24: start network... 03:50:28.032175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:28.521998 run create_hlr_db(pid=5182): Launched 03:50:28.642792 bus /gobi_6: Setting Powered False 03:50:29.705069 run create_hlr_db(pid=5182): Terminated: ok {rc=0} 03:50:30.128492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5185): Launched 03:50:30.424046 run osmo-hlr_10.42.42.2(pid=5186): Launched 03:50:30.535847 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:31.063509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5188): Launched 03:50:31.399524 run osmo-stp_10.42.42.5(pid=5189): Launched 03:50:31.640271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:32.276219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5191): Launched 03:50:32.398132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:32.665740 run patchelf(pid=5192): Launched 03:50:32.841674 run osmo-stp_10.42.42.5(pid=5189): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5189)] 03:50:32.976013 run osmo-stp_10.42.42.5(pid=5189): stdout: | (launched: 2022-12-14_03:50:31.338722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:33.112378 run osmo-stp_10.42.42.5(pid=5189): stderr: | [0;m[38;5;43m20221214035031630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035031631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035031631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035031631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:33.249307 run osmo-stp_10.42.42.5(pid=5189): stdout: | (launched: 2022-12-14_03:50:31.338722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:33.379034 run osmo-stp_10.42.42.5(pid=5189): stderr: | [0;m[38;5;43m20221214035031630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035031631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035031631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035031631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035031632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:33.533413 run patchelf(pid=5192): Terminating (SIGINT) 03:50:33.710724 run patchelf(pid=5192): Terminated: ok {rc=0} 03:50:33.838283 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5189): Process ended prematurely: osmo-stp_10.42.42.5(pid=5189) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5189)] [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 03:50:33.847834 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 03:50:33.875973 run osmo-hlr_10.42.42.2(pid=5186): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5186)] 03:50:33.926927 run osmo-hlr_10.42.42.2(pid=5186): stdout: | (launched: 2022-12-14_03:50:30.369680) 03:50:33.979342 run osmo-hlr_10.42.42.2(pid=5186): stderr: | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035030543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035030559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035030567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035030567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035030567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:34.032270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5185): Terminating (SIGTERM) 03:50:34.074391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5188): Terminating (SIGTERM) 03:50:34.116600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5191): Terminating (SIGTERM) 03:50:34.159518 --- ParallelTerminationStrategy: PID 5185 died... 03:50:34.179844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5185): Terminated: ok {rc=0} 03:50:34.226672 --- ParallelTerminationStrategy: PID 5188 died... 03:50:34.246565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5188): Terminated: ok {rc=0} 03:50:34.293264 --- ParallelTerminationStrategy: PID 5191 died... 03:50:34.313193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5191): Terminated: ok {rc=0} 03:50:34.402416 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:50:35.698420 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:50:35.704179 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:50:35.724484 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:50:35.762630 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:50:35.847386 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:50:35.867653 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:50:35.905380 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:50:36.498838 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:50:36.546769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:36.557548 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:36.612509 tst cs_paging_gprs_active.py: using LAC 38346 03:50:36.738516 tst cs_paging_gprs_active.py: using RAC 96 03:50:36.863367 tst cs_paging_gprs_active.py: using CellId 38346 03:50:37.000552 tst cs_paging_gprs_active.py: using BVCI 38347 03:50:37.118924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.130174 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.141053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.152026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.163175 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.174443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.185765 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.196853 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:37.208245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:37.329639 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:37.445120 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:50:37.646696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:37.945520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5196): Launched 03:50:38.207054 run iperf3-srv_10.42.42.10(pid=5197): Launched 03:50:38.319150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:50:38.518475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:38.818352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Launched 03:50:39.079090 run iperf3-srv_10.42.42.10(pid=5199): Launched 03:50:39.191051 tst cs_paging_gprs_active.py:38: start network... 03:50:39.390874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:39.855167 run create_hlr_db(pid=5200): Launched 03:50:39.978703 bus /gobi_6: Setting Powered False 03:50:41.038236 run create_hlr_db(pid=5200): Terminated: ok {rc=0} 03:50:41.475609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5202): Launched 03:50:41.798076 run osmo-hlr_10.42.42.2(pid=5203): Launched 03:50:41.920625 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:42.495188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5205): Launched 03:50:42.817652 run osmo-stp_10.42.42.5(pid=5206): Launched 03:50:42.939671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:43.493644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5208): Launched 03:50:43.618003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:43.890821 run patchelf(pid=5209): Launched 03:50:44.069215 run osmo-stp_10.42.42.5(pid=5206): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5206)] 03:50:44.205365 run osmo-stp_10.42.42.5(pid=5206): stdout: | (launched: 2022-12-14_03:50:42.758836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:44.343316 run osmo-stp_10.42.42.5(pid=5206): stderr: | [0;m[38;5;43m20221214035042948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035042948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035042949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035042949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:44.481197 run osmo-stp_10.42.42.5(pid=5206): stdout: | (launched: 2022-12-14_03:50:42.758836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:44.613921 run osmo-stp_10.42.42.5(pid=5206): stderr: | [0;m[38;5;43m20221214035042948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035042948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035042949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035042949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035042950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:44.770165 run patchelf(pid=5209): Terminating (SIGINT) 03:50:44.949298 run patchelf(pid=5209): Terminated: ok {rc=0} 03:50:45.078725 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5206): Process ended prematurely: osmo-stp_10.42.42.5(pid=5206) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5206)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:50:45.088794 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:50:45.117302 run osmo-hlr_10.42.42.2(pid=5203): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5203)] 03:50:45.167596 run osmo-hlr_10.42.42.2(pid=5203): stdout: | (launched: 2022-12-14_03:50:41.738851) 03:50:45.219472 run osmo-hlr_10.42.42.2(pid=5203): stderr: | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035041984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035041997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035042007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035042007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035042007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:45.271572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5196): Terminating (SIGTERM) 03:50:45.313417 run iperf3-srv_10.42.42.10(pid=5197): Terminating (SIGTERM) 03:50:45.354858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Terminating (SIGTERM) 03:50:45.396254 run iperf3-srv_10.42.42.10(pid=5199): Terminating (SIGTERM) 03:50:45.437756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5202): Terminating (SIGTERM) 03:50:45.479343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5205): Terminating (SIGTERM) 03:50:45.520642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5208): Terminating (SIGTERM) 03:50:45.562823 --- ParallelTerminationStrategy: PID 5196 died... 03:50:45.582971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5196): Terminated: ok {rc=0} 03:50:45.629029 --- ParallelTerminationStrategy: PID 5197 died... 03:50:45.648487 run iperf3-srv_10.42.42.10(pid=5197): Terminated {rc=256} 03:50:45.694075 --- ParallelTerminationStrategy: PID 5198 died... 03:50:45.713570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5198): Terminated: ok {rc=0} 03:50:45.759240 --- ParallelTerminationStrategy: PID 5199 died... 03:50:45.778744 run iperf3-srv_10.42.42.10(pid=5199): Terminated {rc=256} 03:50:45.824501 --- ParallelTerminationStrategy: PID 5202 died... 03:50:45.847044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5202): Terminated: ok {rc=0} 03:50:45.894227 --- ParallelTerminationStrategy: PID 5205 died... 03:50:45.914442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5205): Terminated: ok {rc=0} 03:50:45.960925 --- ParallelTerminationStrategy: PID 5208 died... 03:50:45.981104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5208): Terminated: ok {rc=0} 03:50:46.073612 bus /gobi_0: Setting Powered False 03:50:47.172746 bus /gobi_0: Setting Powered False 03:50:48.297288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:50:49.443541 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:49.455423 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:49.515976 tst iperf3.py: using LAC 38347 03:50:49.647074 tst iperf3.py: using RAC 97 03:50:49.775140 tst iperf3.py: using CellId 38347 03:50:49.900425 tst iperf3.py: using BVCI 38348 03:50:50.016732 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.028000 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.038985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.050041 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.061440 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.072642 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.084101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.095217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:50.106667 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:50.223199 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:50:50.422525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:50:50.723587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5210): Launched 03:50:50.984165 run iperf3-srv_10.42.42.10(pid=5211): Launched 03:50:51.096014 tst iperf3.py:8: start network... 03:50:51.294624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:50:51.758706 run create_hlr_db(pid=5212): Launched 03:50:51.882171 bus /gobi_6: Setting Powered False 03:50:52.941563 run create_hlr_db(pid=5212): Terminated: ok {rc=0} 03:50:53.378715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Launched 03:50:53.700413 run osmo-hlr_10.42.42.2(pid=5219): Launched 03:50:53.823116 run osmo-stp_10.42.42.5: Starting osmo-stp 03:50:54.374717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Launched 03:50:54.696411 run osmo-stp_10.42.42.5(pid=5222): Launched 03:50:54.819321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:50:55.372391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Launched 03:50:55.494982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:50:55.766707 run patchelf(pid=5225): Launched 03:50:55.944361 run osmo-stp_10.42.42.5(pid=5222): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] 03:50:56.080336 run osmo-stp_10.42.42.5(pid=5222): stdout: | (launched: 2022-12-14_03:50:54.637382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:56.217746 run osmo-stp_10.42.42.5(pid=5222): stderr: | [0;m[38;5;43m20221214035054827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035054827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035054828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035054828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:56.355661 run osmo-stp_10.42.42.5(pid=5222): stdout: | (launched: 2022-12-14_03:50:54.637382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:50:56.487539 run osmo-stp_10.42.42.5(pid=5222): stderr: | [0;m[38;5;43m20221214035054827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035054827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035054828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035054828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035054829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:50:56.644453 run patchelf(pid=5225): Terminating (SIGINT) 03:50:56.823065 run patchelf(pid=5225): Terminated: ok {rc=0} 03:50:56.951979 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5222): Process ended prematurely: osmo-stp_10.42.42.5(pid=5222) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 03:50:56.962396 tst iperf3.py:8: Test FAILED (7.6 sec) 03:50:56.990839 run osmo-hlr_10.42.42.2(pid=5219): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5219)] 03:50:57.041736 run osmo-hlr_10.42.42.2(pid=5219): stdout: | (launched: 2022-12-14_03:50:53.641121) 03:50:57.093893 run osmo-hlr_10.42.42.2(pid=5219): stderr: | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035053838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035053884 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035053894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035053894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035053894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:50:57.146224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5210): Terminating (SIGTERM) 03:50:57.188109 run iperf3-srv_10.42.42.10(pid=5211): Terminating (SIGTERM) 03:50:57.230518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Terminating (SIGTERM) 03:50:57.272474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Terminating (SIGTERM) 03:50:57.314896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Terminating (SIGTERM) 03:50:57.357163 --- ParallelTerminationStrategy: PID 5210 died... 03:50:57.377431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5210): Terminated: ok {rc=0} 03:50:57.424101 --- ParallelTerminationStrategy: PID 5211 died... 03:50:57.444020 run iperf3-srv_10.42.42.10(pid=5211): Terminated {rc=256} 03:50:57.490708 --- ParallelTerminationStrategy: PID 5218 died... 03:50:57.510716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5218): Terminated: ok {rc=0} 03:50:57.557487 --- ParallelTerminationStrategy: PID 5221 died... 03:50:57.577347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5221): Terminated: ok {rc=0} 03:50:57.623888 --- ParallelTerminationStrategy: PID 5224 died... 03:50:57.644016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5224): Terminated: ok {rc=0} 03:50:57.733042 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:50:58.885109 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:58.896923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:50:58.957850 tst iperf3m4.py: using LAC 38348 03:50:59.082887 tst iperf3m4.py: using RAC 98 03:50:59.208030 tst iperf3m4.py: using CellId 38348 03:50:59.333760 tst iperf3m4.py: using BVCI 38349 03:50:59.451860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.463119 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.474142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.485243 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.496498 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.507782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.519285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.530576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:50:59.542377 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:59.660259 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:59.781677 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:50:59.898054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:00.016384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:00.232318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:00.554823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5226): Launched 03:51:00.834849 run iperf3-srv_10.42.42.10(pid=5227): Launched 03:51:00.970625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:51:01.189982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:01.522266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5228): Launched 03:51:01.877573 run iperf3-srv_10.42.42.10(pid=5229): Launched 03:51:02.018694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:51:02.238480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:02.563953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5230): Launched 03:51:02.842752 run iperf3-srv_10.42.42.10(pid=5231): Launched 03:51:02.963239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:51:03.178583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:03.500397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5232): Launched 03:51:03.779856 run iperf3-srv_10.42.42.10(pid=5233): Launched 03:51:03.900406 tst iperf3m4.py:8: start network... 03:51:04.114924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:04.613369 run create_hlr_db(pid=5234): Launched 03:51:04.736144 bus /gobi_6: Setting Powered False 03:51:05.799033 run create_hlr_db(pid=5234): Terminated: ok {rc=0} 03:51:06.244290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Launched 03:51:06.565594 run osmo-hlr_10.42.42.2(pid=5237): Launched 03:51:06.688845 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:07.242411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Launched 03:51:07.563308 run osmo-stp_10.42.42.5(pid=5240): Launched 03:51:07.686423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:08.240638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5242): Launched 03:51:08.363500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:08.635684 run patchelf(pid=5243): Launched 03:51:08.814955 run osmo-stp_10.42.42.5(pid=5240): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] 03:51:08.951179 run osmo-stp_10.42.42.5(pid=5240): stdout: | (launched: 2022-12-14_03:51:07.503507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:09.088820 run osmo-stp_10.42.42.5(pid=5240): stderr: | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035107692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:09.226857 run osmo-stp_10.42.42.5(pid=5240): stdout: | (launched: 2022-12-14_03:51:07.503507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:09.359229 run osmo-stp_10.42.42.5(pid=5240): stderr: | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035107691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035107692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035107692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:09.515593 run patchelf(pid=5243): Terminating (SIGINT) 03:51:09.695695 run patchelf(pid=5243): Terminated: ok {rc=0} 03:51:09.825605 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5240): Process ended prematurely: osmo-stp_10.42.42.5(pid=5240) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:51:09.835666 tst iperf3m4.py:8: Test FAILED (11.0 sec) 03:51:09.864494 run osmo-hlr_10.42.42.2(pid=5237): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5237)] 03:51:09.915359 run osmo-hlr_10.42.42.2(pid=5237): stdout: | (launched: 2022-12-14_03:51:06.505918) 03:51:09.967674 run osmo-hlr_10.42.42.2(pid=5237): stderr: | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035106700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035106712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035106721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035106721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035106721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:10.020729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5226): Terminating (SIGTERM) 03:51:10.062566 run iperf3-srv_10.42.42.10(pid=5227): Terminating (SIGTERM) 03:51:10.106523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5228): Terminating (SIGTERM) 03:51:10.149033 run iperf3-srv_10.42.42.10(pid=5229): Terminating (SIGTERM) 03:51:10.191439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5230): Terminating (SIGTERM) 03:51:10.233729 run iperf3-srv_10.42.42.10(pid=5231): Terminating (SIGTERM) 03:51:10.276172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5232): Terminating (SIGTERM) 03:51:10.318871 run iperf3-srv_10.42.42.10(pid=5233): Terminating (SIGTERM) 03:51:10.360825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Terminating (SIGTERM) 03:51:10.403412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Terminating (SIGTERM) 03:51:10.445743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5242): Terminating (SIGTERM) 03:51:10.488484 --- ParallelTerminationStrategy: PID 5226 died... 03:51:10.508842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5226): Terminated: ok {rc=0} 03:51:10.555751 --- ParallelTerminationStrategy: PID 5227 died... 03:51:10.575682 run iperf3-srv_10.42.42.10(pid=5227): Terminated {rc=256} 03:51:10.622112 --- ParallelTerminationStrategy: PID 5228 died... 03:51:10.642026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5228): Terminated: ok {rc=0} 03:51:10.688458 --- ParallelTerminationStrategy: PID 5229 died... 03:51:10.708300 run iperf3-srv_10.42.42.10(pid=5229): Terminated {rc=256} 03:51:10.754247 --- ParallelTerminationStrategy: PID 5230 died... 03:51:10.773969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5230): Terminated: ok {rc=0} 03:51:10.819789 --- ParallelTerminationStrategy: PID 5231 died... 03:51:10.839559 run iperf3-srv_10.42.42.10(pid=5231): Terminated {rc=256} 03:51:10.885327 --- ParallelTerminationStrategy: PID 5232 died... 03:51:10.905065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5232): Terminated: ok {rc=0} 03:51:10.951027 --- ParallelTerminationStrategy: PID 5233 died... 03:51:10.970881 run iperf3-srv_10.42.42.10(pid=5233): Terminated {rc=256} 03:51:11.016630 --- ParallelTerminationStrategy: PID 5236 died... 03:51:11.036427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Terminated: ok {rc=0} 03:51:11.082383 --- ParallelTerminationStrategy: PID 5239 died... 03:51:11.102265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Terminated: ok {rc=0} 03:51:11.148591 --- ParallelTerminationStrategy: PID 5242 died... 03:51:11.168629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5242): Terminated: ok {rc=0} 03:51:11.256592 bus /gobi_4: Setting Powered False 03:51:12.354902 bus /gobi_4: Setting Powered False 03:51:13.469690 bus /gobi_1: Setting Powered False 03:51:14.570199 bus /gobi_1: Setting Powered False 03:51:15.684405 bus /gobi_0: Setting Powered False 03:51:16.779976 bus /gobi_0: Setting Powered False 03:51:17.892728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:51:18.993975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.005990 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:19.064855 tst ping.py: using LAC 38349 03:51:19.188415 tst ping.py: using RAC 99 03:51:19.314432 tst ping.py: using CellId 38349 03:51:19.439343 tst ping.py: using BVCI 38350 03:51:19.553566 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.565323 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.576330 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.587372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.598618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.609973 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.621503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:19.632800 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:19.747761 tst ping.py:19: start network... 03:51:19.943265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:20.396334 run create_hlr_db(pid=5244): Launched 03:51:20.515940 bus /gobi_6: Setting Powered False 03:51:21.574228 run create_hlr_db(pid=5244): Terminated: ok {rc=0} 03:51:22.006203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5246): Launched 03:51:22.319911 run osmo-hlr_10.42.42.2(pid=5247): Launched 03:51:22.439759 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:22.984451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5249): Launched 03:51:23.297519 run osmo-stp_10.42.42.5(pid=5250): Launched 03:51:23.417280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:23.961270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5252): Launched 03:51:24.082067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:24.348547 run patchelf(pid=5253): Launched 03:51:24.523896 run osmo-stp_10.42.42.5(pid=5250): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5250)] 03:51:24.658363 run osmo-stp_10.42.42.5(pid=5250): stdout: | (launched: 2022-12-14_03:51:23.239627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:24.794128 run osmo-stp_10.42.42.5(pid=5250): stderr: | [0;m[38;5;43m20221214035123428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035123429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035123429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035123429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:24.930006 run osmo-stp_10.42.42.5(pid=5250): stdout: | (launched: 2022-12-14_03:51:23.239627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:25.059544 run osmo-stp_10.42.42.5(pid=5250): stderr: | [0;m[38;5;43m20221214035123428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035123429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035123429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035123429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035123430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:25.212525 run patchelf(pid=5253): Terminating (SIGINT) 03:51:25.388247 run patchelf(pid=5253): Terminated: ok {rc=0} 03:51:25.514643 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5250): Process ended prematurely: osmo-stp_10.42.42.5(pid=5250) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5250)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 03:51:25.524033 tst ping.py:22: Test FAILED (6.5 sec) 03:51:25.551941 run osmo-hlr_10.42.42.2(pid=5247): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5247)] 03:51:25.602486 run osmo-hlr_10.42.42.2(pid=5247): stdout: | (launched: 2022-12-14_03:51:22.262413) 03:51:25.654369 run osmo-hlr_10.42.42.2(pid=5247): stderr: | [0;m[1;31m20221214035122456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035122457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035122457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035122457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035122457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035122457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035122470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035122478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035122478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035122478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:25.706427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5246): Terminating (SIGTERM) 03:51:25.748369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5249): Terminating (SIGTERM) 03:51:25.790969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5252): Terminating (SIGTERM) 03:51:25.833103 --- ParallelTerminationStrategy: PID 5246 died... 03:51:25.853352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5246): Terminated: ok {rc=0} 03:51:25.899561 --- ParallelTerminationStrategy: PID 5249 died... 03:51:25.919289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5249): Terminated: ok {rc=0} 03:51:25.965453 --- ParallelTerminationStrategy: PID 5252 died... 03:51:25.985265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5252): Terminated: ok {rc=0} 03:51:26.074231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:51:27.161722 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.173759 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:51:27.233452 tst ping_idle_ping.py: using LAC 38350 03:51:27.358422 tst ping_idle_ping.py: using RAC 100 03:51:27.481807 tst ping_idle_ping.py: using CellId 38350 03:51:27.605438 tst ping_idle_ping.py: using BVCI 38351 03:51:27.713098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.723902 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.734727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.745590 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.756054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.766768 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.777584 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:51:27.788135 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:51:27.905537 tst ping_idle_ping.py:24: start network... 03:51:28.117174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:28.608257 run create_hlr_db(pid=5254): Launched 03:51:28.728575 bus /gobi_6: Setting Powered False 03:51:29.791893 run create_hlr_db(pid=5254): Terminated: ok {rc=0} 03:51:30.214770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Launched 03:51:30.508277 run osmo-hlr_10.42.42.2(pid=5257): Launched 03:51:30.621341 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:31.238191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Launched 03:51:31.644012 run osmo-stp_10.42.42.5(pid=5260): Launched 03:51:31.808369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:32.557599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Launched 03:51:32.679701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:32.947607 run patchelf(pid=5263): Launched 03:51:33.123596 run osmo-stp_10.42.42.5(pid=5260): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] 03:51:33.257851 run osmo-stp_10.42.42.5(pid=5260): stdout: | (launched: 2022-12-14_03:51:31.570822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:33.394110 run osmo-stp_10.42.42.5(pid=5260): stderr: | [0;m[38;5;43m20221214035131893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035131893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035131894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035131895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:33.530107 run osmo-stp_10.42.42.5(pid=5260): stdout: | (launched: 2022-12-14_03:51:31.570822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:33.660280 run osmo-stp_10.42.42.5(pid=5260): stderr: | [0;m[38;5;43m20221214035131893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035131893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035131894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035131895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035131895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:33.814132 run patchelf(pid=5263): Terminating (SIGINT) 03:51:33.990912 run patchelf(pid=5263): Terminated: ok {rc=0} 03:51:34.118242 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5260): Process ended prematurely: osmo-stp_10.42.42.5(pid=5260) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:51:34.127796 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 03:51:34.155786 run osmo-hlr_10.42.42.2(pid=5257): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5257)] 03:51:34.206386 run osmo-hlr_10.42.42.2(pid=5257): stdout: | (launched: 2022-12-14_03:51:30.453581) 03:51:34.258550 run osmo-hlr_10.42.42.2(pid=5257): stderr: | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035130625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035130638 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035130646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035130646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035130646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:34.311834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Terminating (SIGTERM) 03:51:34.353737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Terminating (SIGTERM) 03:51:34.395708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Terminating (SIGTERM) 03:51:34.438266 --- ParallelTerminationStrategy: PID 5256 died... 03:51:34.458650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Terminated: ok {rc=0} 03:51:34.504900 --- ParallelTerminationStrategy: PID 5259 died... 03:51:34.524853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Terminated: ok {rc=0} 03:51:34.571946 --- ParallelTerminationStrategy: PID 5262 died... 03:51:34.591994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Terminated: ok {rc=0} 03:51:34.680075 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:51:35.969489 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:51:35.975669 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:51:35.996278 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:51:36.034605 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:51:36.120417 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:51:36.140440 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:51:36.177829 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:51:36.771936 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:51:36.819635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:36.830361 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:36.885597 tst cs_paging_gprs_active.py: using LAC 38351 03:51:37.002452 tst cs_paging_gprs_active.py: using RAC 101 03:51:37.121169 tst cs_paging_gprs_active.py: using CellId 38351 03:51:37.238327 tst cs_paging_gprs_active.py: using BVCI 38352 03:51:37.348096 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.358873 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.369412 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.379811 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.390261 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.400724 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.411718 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.422527 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:37.433482 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:37.552623 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:37.668532 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:51:37.868858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:38.170298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5267): Launched 03:51:38.431015 run iperf3-srv_10.42.42.10(pid=5268): Launched 03:51:38.542801 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:51:38.741692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:39.041155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5269): Launched 03:51:39.301851 run iperf3-srv_10.42.42.10(pid=5270): Launched 03:51:39.413719 tst cs_paging_gprs_active.py:38: start network... 03:51:39.613447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:40.079520 run create_hlr_db(pid=5271): Launched 03:51:40.200755 bus /gobi_6: Setting Powered False 03:51:41.260344 run create_hlr_db(pid=5271): Terminated: ok {rc=0} 03:51:41.697595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Launched 03:51:42.019949 run osmo-hlr_10.42.42.2(pid=5274): Launched 03:51:42.142240 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:42.696673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Launched 03:51:43.017902 run osmo-stp_10.42.42.5(pid=5277): Launched 03:51:43.139876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:43.698966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5279): Launched 03:51:43.822566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:44.094815 run patchelf(pid=5280): Launched 03:51:44.273500 run osmo-stp_10.42.42.5(pid=5277): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] 03:51:44.410027 run osmo-stp_10.42.42.5(pid=5277): stdout: | (launched: 2022-12-14_03:51:42.958765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:44.547773 run osmo-stp_10.42.42.5(pid=5277): stderr: | [0;m[38;5;43m20221214035143151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035143151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035143152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035143152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:44.686505 run osmo-stp_10.42.42.5(pid=5277): stdout: | (launched: 2022-12-14_03:51:42.958765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:44.818691 run osmo-stp_10.42.42.5(pid=5277): stderr: | [0;m[38;5;43m20221214035143151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035143151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035143152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035143152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035143153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:44.975372 run patchelf(pid=5280): Terminating (SIGINT) 03:51:45.154714 run patchelf(pid=5280): Terminated: ok {rc=0} 03:51:45.284433 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5277): Process ended prematurely: osmo-stp_10.42.42.5(pid=5277) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:51:45.294687 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:51:45.323032 run osmo-hlr_10.42.42.2(pid=5274): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5274)] 03:51:45.373400 run osmo-hlr_10.42.42.2(pid=5274): stdout: | (launched: 2022-12-14_03:51:41.960625) 03:51:45.425399 run osmo-hlr_10.42.42.2(pid=5274): stderr: | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035142155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035142168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035142176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035142177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035142177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:45.477443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5267): Terminating (SIGTERM) 03:51:45.519027 run iperf3-srv_10.42.42.10(pid=5268): Terminating (SIGTERM) 03:51:45.560779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5269): Terminating (SIGTERM) 03:51:45.603518 run iperf3-srv_10.42.42.10(pid=5270): Terminating (SIGTERM) 03:51:45.645645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Terminating (SIGTERM) 03:51:45.688029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminating (SIGTERM) 03:51:45.730148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5279): Terminating (SIGTERM) 03:51:45.772669 --- ParallelTerminationStrategy: PID 5267 died... 03:51:45.793127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5267): Terminated: ok {rc=0} 03:51:45.840598 --- ParallelTerminationStrategy: PID 5268 died... 03:51:45.873623 run iperf3-srv_10.42.42.10(pid=5268): Terminated {rc=256} 03:51:45.929406 --- ParallelTerminationStrategy: PID 5269 died... 03:51:45.949573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5269): Terminated: ok {rc=0} 03:51:45.997483 --- ParallelTerminationStrategy: PID 5270 died... 03:51:46.018454 run iperf3-srv_10.42.42.10(pid=5270): Terminated {rc=256} 03:51:46.070727 --- ParallelTerminationStrategy: PID 5273 died... 03:51:46.092434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5273): Terminated: ok {rc=0} 03:51:46.139885 --- ParallelTerminationStrategy: PID 5276 died... 03:51:46.161489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminated: ok {rc=0} 03:51:46.209731 --- ParallelTerminationStrategy: PID 5279 died... 03:51:46.231234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5279): Terminated: ok {rc=0} 03:51:46.323339 bus /gobi_0: Setting Powered False 03:51:47.425115 bus /gobi_0: Setting Powered False 03:51:48.541925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:51:49.690694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:49.702631 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:49.764216 tst iperf3.py: using LAC 38352 03:51:49.890508 tst iperf3.py: using RAC 102 03:51:50.016140 tst iperf3.py: using CellId 38352 03:51:50.143521 tst iperf3.py: using BVCI 38353 03:51:50.259691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.270868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.281875 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.292760 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.304117 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.315387 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.326819 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.338037 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:50.349585 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:50.464791 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:51:50.664151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:51:50.964167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5281): Launched 03:51:51.224332 run iperf3-srv_10.42.42.10(pid=5282): Launched 03:51:51.336885 tst iperf3.py:8: start network... 03:51:51.535359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:51:51.997650 run create_hlr_db(pid=5283): Launched 03:51:52.121597 bus /gobi_6: Setting Powered False 03:51:53.181561 run create_hlr_db(pid=5283): Terminated: ok {rc=0} 03:51:53.598522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Launched 03:51:53.897647 run osmo-hlr_10.42.42.2(pid=5286): Launched 03:51:54.011329 run osmo-stp_10.42.42.5: Starting osmo-stp 03:51:54.541999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Launched 03:51:54.840932 run osmo-stp_10.42.42.5(pid=5289): Launched 03:51:54.953285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:51:55.468088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Launched 03:51:55.582464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:51:55.834774 run patchelf(pid=5292): Launched 03:51:56.000191 run osmo-stp_10.42.42.5(pid=5289): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] 03:51:56.126806 run osmo-stp_10.42.42.5(pid=5289): stdout: | (launched: 2022-12-14_03:51:54.784934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:56.254412 run osmo-stp_10.42.42.5(pid=5289): stderr: | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035154957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:56.382250 run osmo-stp_10.42.42.5(pid=5289): stdout: | (launched: 2022-12-14_03:51:54.784934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:51:56.504539 run osmo-stp_10.42.42.5(pid=5289): stderr: | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035154956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035154957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035154957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:51:56.649711 run patchelf(pid=5292): Terminating (SIGINT) 03:51:56.816494 run patchelf(pid=5292): Terminated: ok {rc=0} 03:51:56.936664 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5289): Process ended prematurely: osmo-stp_10.42.42.5(pid=5289) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 03:51:56.946127 tst iperf3.py:8: Test FAILED (7.3 sec) 03:51:56.973091 run osmo-hlr_10.42.42.2(pid=5286): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5286)] 03:51:57.020628 run osmo-hlr_10.42.42.2(pid=5286): stdout: | (launched: 2022-12-14_03:51:53.841975) 03:51:57.070077 run osmo-hlr_10.42.42.2(pid=5286): stderr: | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035154018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035154030 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035154039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035154039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035154039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:51:57.120060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5281): Terminating (SIGTERM) 03:51:57.159874 run iperf3-srv_10.42.42.10(pid=5282): Terminating (SIGTERM) 03:51:57.199490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Terminating (SIGTERM) 03:51:57.239258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Terminating (SIGTERM) 03:51:57.278947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Terminating (SIGTERM) 03:51:57.318800 --- ParallelTerminationStrategy: PID 5281 died... 03:51:57.337734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5281): Terminated: ok {rc=0} 03:51:57.381497 --- ParallelTerminationStrategy: PID 5282 died... 03:51:57.400046 run iperf3-srv_10.42.42.10(pid=5282): Terminated {rc=256} 03:51:57.443467 --- ParallelTerminationStrategy: PID 5285 died... 03:51:57.461892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Terminated: ok {rc=0} 03:51:57.505956 --- ParallelTerminationStrategy: PID 5288 died... 03:51:57.524575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Terminated: ok {rc=0} 03:51:57.568022 --- ParallelTerminationStrategy: PID 5291 died... 03:51:57.586506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Terminated: ok {rc=0} 03:51:57.672027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:51:58.817802 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:58.829304 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:51:58.886579 tst iperf3m4.py: using LAC 38353 03:51:59.004248 tst iperf3m4.py: using RAC 103 03:51:59.122327 tst iperf3m4.py: using CellId 38353 03:51:59.241268 tst iperf3m4.py: using BVCI 38354 03:51:59.348853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.359662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.370220 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.380591 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.391013 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.401504 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.412381 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.423269 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:51:59.433964 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:59.547611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:59.667977 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:59.783693 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:51:59.900529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:52:00.098348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:00.398088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5293): Launched 03:52:00.658357 run iperf3-srv_10.42.42.10(pid=5294): Launched 03:52:00.770383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:52:00.992586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:01.301201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5295): Launched 03:52:01.606615 run iperf3-srv_10.42.42.10(pid=5296): Launched 03:52:01.732802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:52:01.958098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:02.288173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5297): Launched 03:52:02.568709 run iperf3-srv_10.42.42.10(pid=5298): Launched 03:52:02.690214 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:52:02.904696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:52:03.226436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5299): Launched 03:52:03.505906 run iperf3-srv_10.42.42.10(pid=5300): Launched 03:52:03.626817 tst iperf3m4.py:8: start network... 03:52:03.841920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:04.340694 run create_hlr_db(pid=5301): Launched 03:52:04.465730 bus /gobi_6: Setting Powered False 03:52:05.529388 run create_hlr_db(pid=5301): Terminated: ok {rc=0} 03:52:05.957681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5303): Launched 03:52:06.257259 run osmo-hlr_10.42.42.2(pid=5304): Launched 03:52:06.370148 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:06.888615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5306): Launched 03:52:07.187740 run osmo-stp_10.42.42.5(pid=5307): Launched 03:52:07.301289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:07.817528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5309): Launched 03:52:07.931784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:08.185075 run patchelf(pid=5310): Launched 03:52:08.352452 run osmo-stp_10.42.42.5(pid=5307): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5307)] 03:52:08.479465 run osmo-stp_10.42.42.5(pid=5307): stdout: | (launched: 2022-12-14_03:52:07.131972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:08.607808 run osmo-stp_10.42.42.5(pid=5307): stderr: | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035207300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:08.736230 run osmo-stp_10.42.42.5(pid=5307): stdout: | (launched: 2022-12-14_03:52:07.131972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:08.859699 run osmo-stp_10.42.42.5(pid=5307): stderr: | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035207299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035207300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035207300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:09.005338 run patchelf(pid=5310): Terminating (SIGINT) 03:52:09.172260 run patchelf(pid=5310): Terminated: ok {rc=0} 03:52:09.292779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5307): Process ended prematurely: osmo-stp_10.42.42.5(pid=5307) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5307)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:52:09.302291 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:52:09.329665 run osmo-hlr_10.42.42.2(pid=5304): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5304)] 03:52:09.377354 run osmo-hlr_10.42.42.2(pid=5304): stdout: | (launched: 2022-12-14_03:52:06.201329) 03:52:09.427081 run osmo-hlr_10.42.42.2(pid=5304): stderr: | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035206376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035206388 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035206397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035206398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035206398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:09.476939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5293): Terminating (SIGTERM) 03:52:09.516769 run iperf3-srv_10.42.42.10(pid=5294): Terminating (SIGTERM) 03:52:09.556345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5295): Terminating (SIGTERM) 03:52:09.595919 run iperf3-srv_10.42.42.10(pid=5296): Terminating (SIGTERM) 03:52:09.635444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5297): Terminating (SIGTERM) 03:52:09.675026 run iperf3-srv_10.42.42.10(pid=5298): Terminating (SIGTERM) 03:52:09.714451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5299): Terminating (SIGTERM) 03:52:09.754017 run iperf3-srv_10.42.42.10(pid=5300): Terminating (SIGTERM) 03:52:09.793492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5303): Terminating (SIGTERM) 03:52:09.833267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5306): Terminating (SIGTERM) 03:52:09.873349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5309): Terminating (SIGTERM) 03:52:09.913260 --- ParallelTerminationStrategy: PID 5293 died... 03:52:09.932098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5293): Terminated: ok {rc=0} 03:52:09.976131 --- ParallelTerminationStrategy: PID 5294 died... 03:52:09.994570 run iperf3-srv_10.42.42.10(pid=5294): Terminated {rc=256} 03:52:10.037748 --- ParallelTerminationStrategy: PID 5295 died... 03:52:10.056025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5295): Terminated: ok {rc=0} 03:52:10.099413 --- ParallelTerminationStrategy: PID 5296 died... 03:52:10.117774 run iperf3-srv_10.42.42.10(pid=5296): Terminated {rc=256} 03:52:10.160845 --- ParallelTerminationStrategy: PID 5297 died... 03:52:10.179709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5297): Terminated: ok {rc=0} 03:52:10.223421 --- ParallelTerminationStrategy: PID 5298 died... 03:52:10.242011 run iperf3-srv_10.42.42.10(pid=5298): Terminated {rc=256} 03:52:10.285245 --- ParallelTerminationStrategy: PID 5299 died... 03:52:10.303576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5299): Terminated: ok {rc=0} 03:52:10.346806 --- ParallelTerminationStrategy: PID 5300 died... 03:52:10.365200 run iperf3-srv_10.42.42.10(pid=5300): Terminated {rc=256} 03:52:10.408205 --- ParallelTerminationStrategy: PID 5303 died... 03:52:10.426625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5303): Terminated: ok {rc=0} 03:52:10.469902 --- ParallelTerminationStrategy: PID 5306 died... 03:52:10.488272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5306): Terminated: ok {rc=0} 03:52:10.531702 --- ParallelTerminationStrategy: PID 5309 died... 03:52:10.550288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5309): Terminated: ok {rc=0} 03:52:10.636135 bus /gobi_4: Setting Powered False 03:52:11.736724 bus /gobi_4: Setting Powered False 03:52:12.852481 bus /gobi_1: Setting Powered False 03:52:13.950229 bus /gobi_1: Setting Powered False 03:52:15.065795 bus /gobi_0: Setting Powered False 03:52:16.171374 bus /gobi_0: Setting Powered False 03:52:17.306381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:52:18.409628 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.420882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:18.477427 tst ping.py: using LAC 38354 03:52:18.594529 tst ping.py: using RAC 104 03:52:18.708889 tst ping.py: using CellId 38354 03:52:18.824119 tst ping.py: using BVCI 38355 03:52:18.931795 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.943076 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.953814 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.964343 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.974832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.985341 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:18.997404 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:19.008048 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:19.122039 tst ping.py:19: start network... 03:52:19.316480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:19.769833 run create_hlr_db(pid=5311): Launched 03:52:19.889037 bus /gobi_6: Setting Powered False 03:52:20.948147 run create_hlr_db(pid=5311): Terminated: ok {rc=0} 03:52:21.378084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Launched 03:52:21.693676 run osmo-hlr_10.42.42.2(pid=5314): Launched 03:52:21.813272 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:22.361437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Launched 03:52:22.677903 run osmo-stp_10.42.42.5(pid=5317): Launched 03:52:22.797869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:23.343130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Launched 03:52:23.464001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:23.730655 run patchelf(pid=5320): Launched 03:52:23.905965 run osmo-stp_10.42.42.5(pid=5317): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] 03:52:24.039747 run osmo-stp_10.42.42.5(pid=5317): stdout: | (launched: 2022-12-14_03:52:22.619479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:24.177301 run osmo-stp_10.42.42.5(pid=5317): stderr: | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035222811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:24.313316 run osmo-stp_10.42.42.5(pid=5317): stdout: | (launched: 2022-12-14_03:52:22.619479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:24.442926 run osmo-stp_10.42.42.5(pid=5317): stderr: | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035222811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035222811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:24.596628 run patchelf(pid=5320): Terminating (SIGINT) 03:52:24.773259 run patchelf(pid=5320): Terminated: ok {rc=0} 03:52:24.900235 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5317): Process ended prematurely: osmo-stp_10.42.42.5(pid=5317) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 03:52:24.909954 tst ping.py:22: Test FAILED (6.5 sec) 03:52:24.938112 run osmo-hlr_10.42.42.2(pid=5314): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5314)] 03:52:24.989637 run osmo-hlr_10.42.42.2(pid=5314): stdout: | (launched: 2022-12-14_03:52:21.635644) 03:52:25.042793 run osmo-hlr_10.42.42.2(pid=5314): stderr: | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035221831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035221843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035221851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035221851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035221852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:25.095687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Terminating (SIGTERM) 03:52:25.137984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Terminating (SIGTERM) 03:52:25.180925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Terminating (SIGTERM) 03:52:25.223750 --- ParallelTerminationStrategy: PID 5313 died... 03:52:25.244304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Terminated: ok {rc=0} 03:52:25.291281 --- ParallelTerminationStrategy: PID 5316 died... 03:52:25.311360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Terminated: ok {rc=0} 03:52:25.357939 --- ParallelTerminationStrategy: PID 5319 died... 03:52:25.377992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Terminated: ok {rc=0} 03:52:25.466034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:52:26.554848 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:26.567482 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:52:26.628820 tst ping_idle_ping.py: using LAC 38355 03:52:26.753832 tst ping_idle_ping.py: using RAC 105 03:52:26.880201 tst ping_idle_ping.py: using CellId 38355 03:52:27.003636 tst ping_idle_ping.py: using BVCI 38356 03:52:27.118616 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.129971 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.141043 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.152175 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.163668 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.175134 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.186787 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:52:27.198348 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:52:27.312885 tst ping_idle_ping.py:24: start network... 03:52:27.509297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:27.971994 run create_hlr_db(pid=5321): Launched 03:52:28.093289 bus /gobi_6: Setting Powered False 03:52:29.151946 run create_hlr_db(pid=5321): Terminated: ok {rc=0} 03:52:29.584012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Launched 03:52:29.900033 run osmo-hlr_10.42.42.2(pid=5324): Launched 03:52:30.021100 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:30.571140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Launched 03:52:30.901997 run osmo-stp_10.42.42.5(pid=5327): Launched 03:52:31.058571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:31.750450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5329): Launched 03:52:31.880242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:32.161759 run patchelf(pid=5330): Launched 03:52:32.339845 run osmo-stp_10.42.42.5(pid=5327): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] 03:52:32.474394 run osmo-stp_10.42.42.5(pid=5327): stdout: | (launched: 2022-12-14_03:52:30.830238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:32.610727 run osmo-stp_10.42.42.5(pid=5327): stderr: | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035231166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035231166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035231167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035231167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:32.746762 run osmo-stp_10.42.42.5(pid=5327): stdout: | (launched: 2022-12-14_03:52:30.830238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:32.876225 run osmo-stp_10.42.42.5(pid=5327): stderr: | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035231165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035231166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035231166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035231167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035231167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:33.030118 run patchelf(pid=5330): Terminating (SIGINT) 03:52:33.206747 run patchelf(pid=5330): Terminated: ok {rc=0} 03:52:33.334443 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5327): Process ended prematurely: osmo-stp_10.42.42.5(pid=5327) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:52:33.344369 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 03:52:33.372495 run osmo-hlr_10.42.42.2(pid=5324): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5324)] 03:52:33.423061 run osmo-hlr_10.42.42.2(pid=5324): stdout: | (launched: 2022-12-14_03:52:29.842019) 03:52:33.475345 run osmo-hlr_10.42.42.2(pid=5324): stderr: | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035230039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035230051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035230059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035230060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035230060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:33.527625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Terminating (SIGTERM) 03:52:33.569901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Terminating (SIGTERM) 03:52:33.612440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5329): Terminating (SIGTERM) 03:52:33.655291 --- ParallelTerminationStrategy: PID 5323 died... 03:52:33.675551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5323): Terminated: ok {rc=0} 03:52:33.721786 --- ParallelTerminationStrategy: PID 5326 died... 03:52:33.741584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5326): Terminated: ok {rc=0} 03:52:33.787768 --- ParallelTerminationStrategy: PID 5329 died... 03:52:33.807829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5329): Terminated: ok {rc=0} 03:52:33.896400 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:52:35.187107 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:35.194374 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:52:35.215370 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:52:35.251371 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:52:35.306457 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:52:35.327373 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:52:35.362724 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:52:35.920152 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:52:35.925427 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:35.936710 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:52:35.993613 tst switch_tch_pdch.py: using LAC 38356 03:52:36.116073 tst switch_tch_pdch.py: using RAC 106 03:52:36.238305 tst switch_tch_pdch.py: using CellId 38356 03:52:36.355806 tst switch_tch_pdch.py: using BVCI 38357 03:52:36.463240 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.474555 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.485477 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.496293 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.507630 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.518924 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.530439 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:52:36.541814 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:36.661539 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:52:36.778923 tst switch_tch_pdch.py:51: start network... 03:52:36.974545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:37.431067 run create_hlr_db(pid=5334): Launched 03:52:37.551245 bus /gobi_6: Setting Powered False 03:52:38.610324 run create_hlr_db(pid=5334): Terminated: ok {rc=0} 03:52:39.041833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5336): Launched 03:52:39.356203 run osmo-hlr_10.42.42.2(pid=5337): Launched 03:52:39.477564 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:40.027233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5339): Launched 03:52:40.342355 run osmo-stp_10.42.42.5(pid=5340): Launched 03:52:40.462501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:41.006476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5342): Launched 03:52:41.126661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:41.392169 run patchelf(pid=5343): Launched 03:52:41.567256 run osmo-stp_10.42.42.5(pid=5340): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5340)] 03:52:41.701060 run osmo-stp_10.42.42.5(pid=5340): stdout: | (launched: 2022-12-14_03:52:40.283815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:41.836481 run osmo-stp_10.42.42.5(pid=5340): stderr: | [0;m[38;5;43m20221214035240472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035240472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035240473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035240473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035240473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035240474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035240474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:41.971673 run osmo-stp_10.42.42.5(pid=5340): stdout: | (launched: 2022-12-14_03:52:40.283815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:42.100730 run osmo-stp_10.42.42.5(pid=5340): stderr: | [0;m[38;5;43m20221214035240472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035240472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035240473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035240473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035240473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035240474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035240474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:42.253823 run patchelf(pid=5343): Terminating (SIGINT) 03:52:42.429823 run patchelf(pid=5343): Terminated: ok {rc=0} 03:52:42.557186 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5340): Process ended prematurely: osmo-stp_10.42.42.5(pid=5340) [trial-2399↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5340)] [trial-2399↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:52:42.566796 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 03:52:42.594917 run osmo-hlr_10.42.42.2(pid=5337): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5337)] 03:52:42.645809 run osmo-hlr_10.42.42.2(pid=5337): stdout: | (launched: 2022-12-14_03:52:39.298146) 03:52:42.697598 run osmo-hlr_10.42.42.2(pid=5337): stderr: | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035239494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035239504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035239512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035239512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035239512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:42.749709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5336): Terminating (SIGTERM) 03:52:42.791031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5339): Terminating (SIGTERM) 03:52:42.832885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5342): Terminating (SIGTERM) 03:52:42.874803 --- ParallelTerminationStrategy: PID 5336 died... 03:52:42.894853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5336): Terminated: ok {rc=0} 03:52:42.940506 --- ParallelTerminationStrategy: PID 5339 died... 03:52:42.959935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5339): Terminated: ok {rc=0} 03:52:43.005420 --- ParallelTerminationStrategy: PID 5342 died... 03:52:43.024714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5342): Terminated: ok {rc=0} 03:52:43.111772 bus /gobi_0: Setting Powered False 03:52:44.207613 bus /gobi_0: Setting Powered False 03:52:45.321771 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:52:46.603922 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:46.614036 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:52:46.640862 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:52:46.677713 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:52:46.732493 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:52:46.759761 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:52:46.803964 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:52:47.342981 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:52:47.348532 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.360015 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:52:47.423240 tst switch_tch_pdch.py: using LAC 38357 03:52:47.547778 tst switch_tch_pdch.py: using RAC 107 03:52:47.673638 tst switch_tch_pdch.py: using CellId 38357 03:52:47.792750 tst switch_tch_pdch.py: using BVCI 38358 03:52:47.899442 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.910490 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.921037 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.931617 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.942125 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.952560 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.964109 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:52:47.974723 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:52:48.091899 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:52:48.208259 tst switch_tch_pdch.py:51: start network... 03:52:48.402592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:52:48.830464 run create_hlr_db(pid=5348): Launched 03:52:48.950257 bus /gobi_6: Setting Powered False 03:52:50.008479 run create_hlr_db(pid=5348): Terminated: ok {rc=0} 03:52:50.411225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5350): Launched 03:52:50.726273 run osmo-hlr_10.42.42.2(pid=5351): Launched 03:52:50.846280 run osmo-stp_10.42.42.5: Starting osmo-stp 03:52:51.363711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5353): Launched 03:52:51.678820 run osmo-stp_10.42.42.5(pid=5354): Launched 03:52:51.798874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:52:52.314720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5356): Launched 03:52:52.435352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:52:52.701633 run patchelf(pid=5357): Launched 03:52:52.876473 run osmo-stp_10.42.42.5(pid=5354): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5354)] 03:52:53.009701 run osmo-stp_10.42.42.5(pid=5354): stdout: | (launched: 2022-12-14_03:52:51.620923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:53.145115 run osmo-stp_10.42.42.5(pid=5354): stderr: | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035251810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:53.281312 run osmo-stp_10.42.42.5(pid=5354): stdout: | (launched: 2022-12-14_03:52:51.620923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:52:53.410666 run osmo-stp_10.42.42.5(pid=5354): stderr: | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035251809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035251810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035251810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:52:53.564098 run patchelf(pid=5357): Terminating (SIGINT) 03:52:53.740310 run patchelf(pid=5357): Terminated: ok {rc=0} 03:52:53.866991 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5354): Process ended prematurely: osmo-stp_10.42.42.5(pid=5354) [trial-2399↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5354)] [trial-2399↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:52:53.876490 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:52:53.904349 run osmo-hlr_10.42.42.2(pid=5351): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5351)] 03:52:53.955571 run osmo-hlr_10.42.42.2(pid=5351): stdout: | (launched: 2022-12-14_03:52:50.668722) 03:52:54.007754 run osmo-hlr_10.42.42.2(pid=5351): stderr: | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035250863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035250875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035250885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035250885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035250886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:52:54.060496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5350): Terminating (SIGTERM) 03:52:54.102210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5353): Terminating (SIGTERM) 03:52:54.144204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5356): Terminating (SIGTERM) 03:52:54.186329 --- ParallelTerminationStrategy: PID 5350 died... 03:52:54.206351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5350): Terminated: ok {rc=0} 03:52:54.252273 --- ParallelTerminationStrategy: PID 5353 died... 03:52:54.271908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5353): Terminated: ok {rc=0} 03:52:54.317878 --- ParallelTerminationStrategy: PID 5356 died... 03:52:54.337435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5356): Terminated: ok {rc=0} 03:52:54.426047 bus /gobi_0: Setting Powered False 03:52:55.523963 bus /gobi_0: Setting Powered False 03:52:56.641341 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:trx-b200 --------------------------------------------------------------------- 03:52:57.878600 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:52:57.882681 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:52:57.916316 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:52:57.924351 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:52:57.978586 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:52:58.012322 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:52:58.019175 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:52:58.554591 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:52:58.559751 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 03:52:58.570522 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 03:52:58.618621 tst mo_mt_sms.py: using LAC 38358 03:52:58.734008 tst mo_mt_sms.py: using RAC 108 03:52:58.849393 tst mo_mt_sms.py: using CellId 38358 03:52:58.965536 tst mo_mt_sms.py: using BVCI 38359 03:52:59.071295 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:59.186704 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 03:52:59.300323 tst mo_mt_sms.py:9: start nitb and bts... 03:52:59.497624 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:53:00.100600 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5363): Launched 03:53:00.394161 run osmo-nitb_10.42.42.2(pid=5364): Launched 03:53:00.556876 run osmo-nitb_10.42.42.2(pid=5364): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5364)] 03:53:00.690165 run osmo-nitb_10.42.42.2(pid=5364): stdout: | (launched: 2022-12-14_03:53:00.339764) 03:53:00.824273 run osmo-nitb_10.42.42.2(pid=5364): stderr: | (launched: 2022-12-14_03:53:00.383325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:00.992262 run osmo-nitb_10.42.42.2(pid=5364): stdout: | (launched: 2022-12-14_03:53:00.339764) 03:53:01.133332 run osmo-nitb_10.42.42.2(pid=5364): stderr: | (launched: 2022-12-14_03:53:00.383325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5364): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5364) [trial-2399↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5364)] 03:53:01.504349 tst osmo-nitb_10.42.42.2(pid=5364): stdout: | (launched: 2022-12-14_03:53:00.339764) 03:53:01.624498 tst osmo-nitb_10.42.42.2(pid=5364): stderr: | (launched: 2022-12-14_03:53:00.383325) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:01.766835 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=5364): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5364) [trial-2399↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5364)] [trial-2399↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 03:53:01.775530 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 03:53:01.783943 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5363): Terminating (SIGTERM) 03:53:01.994520 --- ParallelTerminationStrategy: PID 5363 died... 03:53:02.026096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5363): Terminated: ok {rc=0} 03:53:02.146891 bus /sierra_3: Setting Powered False 03:53:03.259341 bus /sierra_3: Setting Powered False 03:53:04.378290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:trx-b200 --------------------------------------------------------------------- 03:53:05.581415 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:05.585929 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:05.618877 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:53:05.645806 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 03:53:05.696892 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:05.730773 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:53:05.758126 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 03:53:06.302174 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 03:53:06.307297 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.317969 tst sms:trx-b200: Using 1 x bts (candidates: 1) 03:53:06.365205 tst mo_mt_sms.py: using LAC 38359 03:53:06.492742 tst mo_mt_sms.py: using RAC 109 03:53:06.616668 tst mo_mt_sms.py: using CellId 38359 03:53:06.733399 tst mo_mt_sms.py: using BVCI 38360 03:53:06.841651 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.852158 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.862624 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.873123 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.883651 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:06.894273 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:07.011139 tst sms:trx-b200: Using 1 x modem (candidates: 2) 03:53:07.129298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:07.618033 run create_hlr_db(pid=5368): Launched 03:53:07.738748 bus /sierra_2: Setting Powered False 03:53:08.798036 run create_hlr_db(pid=5368): Terminated: ok {rc=0} 03:53:09.218605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5370): Launched 03:53:09.512464 run osmo-hlr_10.42.42.2(pid=5371): Launched 03:53:09.624746 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:10.135702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5373): Launched 03:53:10.429303 run osmo-stp_10.42.42.5(pid=5374): Launched 03:53:10.540742 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:11.073652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5376): Launched 03:53:11.368941 run osmo-msc_10.42.42.6(pid=5377): Launched 03:53:11.532273 run osmo-stp_10.42.42.5(pid=5374): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5374)] 03:53:11.657251 run osmo-stp_10.42.42.5(pid=5374): stdout: | (launched: 2022-12-14_03:53:10.374730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:11.781621 run osmo-stp_10.42.42.5(pid=5374): stderr: | [0;m[38;5;43m20221214035310542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035310542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035310543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035310543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035310543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035310543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035310544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:11.903951 run osmo-stp_10.42.42.5(pid=5374): stdout: | (launched: 2022-12-14_03:53:10.374730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:12.020514 run osmo-stp_10.42.42.5(pid=5374): stderr: | [0;m[38;5;43m20221214035310542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035310542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035310543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035310543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035310543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035310543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035310544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:12.159881 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5374): Process ended prematurely: osmo-stp_10.42.42.5(pid=5374) [trial-2399↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5374)] [trial-2399↪sms:trx-b200↪mo_mt_sms.py:16] 03:53:12.168222 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 03:53:12.194008 run osmo-hlr_10.42.42.2(pid=5371): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5371)] 03:53:12.241638 run osmo-hlr_10.42.42.2(pid=5371): stdout: | (launched: 2022-12-14_03:53:09.458152) 03:53:12.290502 run osmo-hlr_10.42.42.2(pid=5371): stderr: | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035309633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035309645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035309654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035309654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035309654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:12.358768 run osmo-msc_10.42.42.6(pid=5377): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5377)] 03:53:12.405862 run osmo-msc_10.42.42.6(pid=5377): stdout: | (launched: 2022-12-14_03:53:11.314173) 03:53:12.454793 run osmo-msc_10.42.42.6(pid=5377): stderr: | [0;m[38;5;43m20221214035311584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035311584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f32ae0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035311584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035311584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035311584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035311584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035311586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035311586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035311587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035311587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:12.504040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5370): Terminating (SIGTERM) 03:53:12.543301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5373): Terminating (SIGTERM) 03:53:12.583208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5376): Terminating (SIGTERM) 03:53:12.622921 --- ParallelTerminationStrategy: PID 5370 died... 03:53:12.641964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5370): Terminated: ok {rc=0} 03:53:12.685897 --- ParallelTerminationStrategy: PID 5373 died... 03:53:12.704272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5373): Terminated: ok {rc=0} 03:53:12.749048 --- ParallelTerminationStrategy: PID 5376 died... 03:53:12.767633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5376): Terminated: ok {rc=0} 03:53:12.850643 bus /sierra_3: Setting Powered False 03:53:13.948508 bus /sierra_3: Setting Powered False 03:53:15.067324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-b200 --------------------------------------------------------------------- 03:53:16.343789 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:16.350738 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:16.387312 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 03:53:16.395981 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:53:16.436094 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:16.482301 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 03:53:16.492528 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:53:16.990731 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:53:16.999182 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 03:53:17.014678 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 03:53:17.077029 tst assert_extension.py: using LAC 38360 03:53:17.219369 tst assert_extension.py: using RAC 110 03:53:17.336704 tst assert_extension.py: using CellId 38360 03:53:17.453143 tst assert_extension.py: using BVCI 38361 03:53:17.560072 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 03:53:17.677387 tst assert_extension.py:10: start nitb and bts... 03:53:17.888838 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:53:18.531087 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5382): Launched 03:53:18.846213 run osmo-nitb_10.42.42.2(pid=5383): Launched 03:53:19.020179 run osmo-nitb_10.42.42.2(pid=5383): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5383)] 03:53:19.162019 run osmo-nitb_10.42.42.2(pid=5383): stdout: | (launched: 2022-12-14_03:53:18.788268) 03:53:19.305134 run osmo-nitb_10.42.42.2(pid=5383): stderr: | (launched: 2022-12-14_03:53:18.835154) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:19.448529 run osmo-nitb_10.42.42.2(pid=5383): stdout: | (launched: 2022-12-14_03:53:18.788268) 03:53:19.585895 run osmo-nitb_10.42.42.2(pid=5383): stderr: | (launched: 2022-12-14_03:53:18.835154) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5383) [trial-2399↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5383)] 03:53:19.964418 tst osmo-nitb_10.42.42.2(pid=5383): stdout: | (launched: 2022-12-14_03:53:18.788268) 03:53:20.091409 tst osmo-nitb_10.42.42.2(pid=5383): stderr: | (launched: 2022-12-14_03:53:18.835154) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:53:20.241023 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5383) [trial-2399↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5383)] [trial-2399↪nitb_ussd:trx-b200↪assert_extension.py:12] 03:53:20.249982 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:53:20.256875 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5382): Terminating (SIGTERM) 03:53:20.468052 --- ParallelTerminationStrategy: PID 5382 died... 03:53:20.489513 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5382): Terminated: ok {rc=0} 03:53:20.578454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:trx-b200 --------------------------------------------------------------------- 03:53:21.754780 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:21.759097 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 03:53:21.792675 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:53:21.820021 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 03:53:21.856375 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 03:53:21.890317 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:53:21.917773 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 03:53:22.445506 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:trx-b200 assert_extension.py ---------------------------------------------- 03:53:22.450911 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:22.462085 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 03:53:22.515659 tst assert_extension.py: using LAC 38361 03:53:22.639872 tst assert_extension.py: using RAC 111 03:53:22.762387 tst assert_extension.py: using CellId 38361 03:53:22.884866 tst assert_extension.py: using BVCI 38362 03:53:22.999713 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:23.010827 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:23.021874 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:23.032742 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:23.044594 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 03:53:23.056503 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 03:53:23.172239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:23.661150 run create_hlr_db(pid=5387): Launched 03:53:23.781074 bus /sierra_2: Setting Powered False 03:53:24.843567 run create_hlr_db(pid=5387): Terminated: ok {rc=0} 03:53:25.264643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Launched 03:53:25.558972 run osmo-hlr_10.42.42.2(pid=5390): Launched 03:53:25.670381 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:26.191371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Launched 03:53:26.484609 run osmo-stp_10.42.42.5(pid=5393): Launched 03:53:26.597013 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:27.126829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5395): Launched 03:53:27.418720 run osmo-msc_10.42.42.6(pid=5396): Launched 03:53:27.581942 run osmo-stp_10.42.42.5(pid=5393): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] 03:53:27.705407 run osmo-stp_10.42.42.5(pid=5393): stdout: | (launched: 2022-12-14_03:53:26.430061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:27.829705 run osmo-stp_10.42.42.5(pid=5393): stderr: | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035326598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:27.952007 run osmo-stp_10.42.42.5(pid=5393): stdout: | (launched: 2022-12-14_03:53:26.430061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:28.068141 run osmo-stp_10.42.42.5(pid=5393): stderr: | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035326597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035326598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035326598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:28.207325 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5393): Process ended prematurely: osmo-stp_10.42.42.5(pid=5393) [trial-2399↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] [trial-2399↪ussd:trx-b200↪assert_extension.py:17] 03:53:28.215681 tst assert_extension.py:17: Test FAILED (5.8 sec) 03:53:28.241671 run osmo-hlr_10.42.42.2(pid=5390): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5390)] 03:53:28.289313 run osmo-hlr_10.42.42.2(pid=5390): stdout: | (launched: 2022-12-14_03:53:25.504327) 03:53:28.338516 run osmo-hlr_10.42.42.2(pid=5390): stderr: | [0;m[1;31m20221214035325677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035325677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035325677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035325677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035325677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035325678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035325690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035325698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035325699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035325699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:28.406950 run osmo-msc_10.42.42.6(pid=5396): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5396)] 03:53:28.454259 run osmo-msc_10.42.42.6(pid=5396): stdout: | (launched: 2022-12-14_03:53:27.363956) 03:53:28.503108 run osmo-msc_10.42.42.6(pid=5396): stderr: | [0;m[38;5;43m20221214035327636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035327636 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa340e9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035327636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035327636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035327636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035327636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035327638 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035327638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035327639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035327639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:28.552504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Terminating (SIGTERM) 03:53:28.591971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Terminating (SIGTERM) 03:53:28.631904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5395): Terminating (SIGTERM) 03:53:28.672335 --- ParallelTerminationStrategy: PID 5389 died... 03:53:28.691477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5389): Terminated: ok {rc=0} 03:53:28.735287 --- ParallelTerminationStrategy: PID 5392 died... 03:53:28.753878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5392): Terminated: ok {rc=0} 03:53:28.797494 --- ParallelTerminationStrategy: PID 5395 died... 03:53:28.816059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5395): Terminated: ok {rc=0} 03:53:28.900399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:53:30.112509 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:30.119480 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:53:30.152279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:53:30.178337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:53:30.230273 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:53:30.263967 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:53:30.290053 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:53:30.845277 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:53:30.903528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:30.916177 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:53:30.991647 tst mo_mt_call.py: using LAC 38362 03:53:31.120852 tst mo_mt_call.py: using RAC 112 03:53:31.320009 tst mo_mt_call.py: using CellId 38362 03:53:31.453404 tst mo_mt_call.py: using BVCI 38363 03:53:31.575329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:31.588425 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:31.600859 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:31.614587 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:31.627409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:31.641330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:31.770822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:31.897183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:32.423356 run create_hlr_db(pid=5401): Launched 03:53:32.546062 bus /sierra_2: Setting Powered False 03:53:33.605768 run create_hlr_db(pid=5401): Terminated: ok {rc=0} 03:53:34.023475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Launched 03:53:34.322798 run osmo-hlr_10.42.42.2(pid=5404): Launched 03:53:34.436229 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:34.968152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Launched 03:53:35.267895 run osmo-stp_10.42.42.5(pid=5407): Launched 03:53:35.381862 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:35.922800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Launched 03:53:36.222765 run osmo-msc_10.42.42.6(pid=5410): Launched 03:53:36.390001 run osmo-stp_10.42.42.5(pid=5407): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] 03:53:36.516938 run osmo-stp_10.42.42.5(pid=5407): stdout: | (launched: 2022-12-14_03:53:35.212445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:36.643650 run osmo-stp_10.42.42.5(pid=5407): stderr: | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035335384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:36.768324 run osmo-stp_10.42.42.5(pid=5407): stdout: | (launched: 2022-12-14_03:53:35.212445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:36.887238 run osmo-stp_10.42.42.5(pid=5407): stderr: | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035335383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035335384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035335384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:37.030637 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5407): Process ended prematurely: osmo-stp_10.42.42.5(pid=5407) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:53:37.039388 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:53:37.065663 run osmo-hlr_10.42.42.2(pid=5404): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5404)] 03:53:37.113176 run osmo-hlr_10.42.42.2(pid=5404): stdout: | (launched: 2022-12-14_03:53:34.267435) 03:53:37.162175 run osmo-hlr_10.42.42.2(pid=5404): stderr: | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035334442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035334454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035334463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035334463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035334463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:37.230318 run osmo-msc_10.42.42.6(pid=5410): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5410)] 03:53:37.278202 run osmo-msc_10.42.42.6(pid=5410): stdout: | (launched: 2022-12-14_03:53:36.167255) 03:53:37.327522 run osmo-msc_10.42.42.6(pid=5410): stderr: | [0;m[38;5;43m20221214035336437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035336437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2be4ed6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035336437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035336437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035336438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035336438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035336439 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035336440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035336440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035336440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:37.377201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Terminating (SIGTERM) 03:53:37.416942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Terminating (SIGTERM) 03:53:37.457166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Terminating (SIGTERM) 03:53:37.497365 --- ParallelTerminationStrategy: PID 5403 died... 03:53:37.516374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5403): Terminated: ok {rc=0} 03:53:37.560797 --- ParallelTerminationStrategy: PID 5406 died... 03:53:37.579339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5406): Terminated: ok {rc=0} 03:53:37.622518 --- ParallelTerminationStrategy: PID 5409 died... 03:53:37.641052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5409): Terminated: ok {rc=0} 03:53:37.726829 bus /sierra_3: Setting Powered False 03:53:38.826021 bus /sierra_3: Setting Powered False 03:53:39.943272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:53:41.094547 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.106988 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:53:41.176673 tst mo_mt_call_osmux.py: using LAC 38363 03:53:41.305439 tst mo_mt_call_osmux.py: using RAC 113 03:53:41.430522 tst mo_mt_call_osmux.py: using CellId 38363 03:53:41.554514 tst mo_mt_call_osmux.py: using BVCI 38364 03:53:41.671793 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.683285 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.694588 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.705803 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.717514 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:53:41.728920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:41.844403 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:53:41.964100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:42.461717 run create_hlr_db(pid=5412): Launched 03:53:42.584018 bus /sierra_2: Setting Powered False 03:53:43.647064 run create_hlr_db(pid=5412): Terminated: ok {rc=0} 03:53:44.093192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5414): Launched 03:53:44.413237 run osmo-hlr_10.42.42.2(pid=5415): Launched 03:53:44.535725 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:45.086472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5417): Launched 03:53:45.408060 run osmo-stp_10.42.42.5(pid=5418): Launched 03:53:45.530905 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:46.151493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5420): Launched 03:53:46.481653 run osmo-msc_10.42.42.6(pid=5421): Launched 03:53:46.766191 run osmo-stp_10.42.42.5(pid=5418): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5418)] 03:53:47.014693 run osmo-stp_10.42.42.5(pid=5418): stdout: | (launched: 2022-12-14_03:53:45.348848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:47.197590 run osmo-stp_10.42.42.5(pid=5418): stderr: | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035345538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:47.334624 run osmo-stp_10.42.42.5(pid=5418): stdout: | (launched: 2022-12-14_03:53:45.348848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:47.465217 run osmo-stp_10.42.42.5(pid=5418): stderr: | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035345537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035345538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035345538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:47.617984 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5418): Process ended prematurely: osmo-stp_10.42.42.5(pid=5418) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5418)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:53:47.628057 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:53:47.656008 run osmo-hlr_10.42.42.2(pid=5415): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5415)] 03:53:47.706740 run osmo-hlr_10.42.42.2(pid=5415): stdout: | (launched: 2022-12-14_03:53:44.354520) 03:53:47.758961 run osmo-hlr_10.42.42.2(pid=5415): stderr: | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035344551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035344596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035344606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035344607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035344607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:47.831491 run osmo-msc_10.42.42.6(pid=5421): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5421)] 03:53:47.881387 run osmo-msc_10.42.42.6(pid=5421): stdout: | (launched: 2022-12-14_03:53:46.421661) 03:53:47.933267 run osmo-msc_10.42.42.6(pid=5421): stderr: | [0;m[38;5;43m20221214035346827 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035346827 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce7cc8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035346827 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035346827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035346827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035346828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035346829 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035346830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035346830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035346830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:47.985776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5414): Terminating (SIGTERM) 03:53:48.027545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5417): Terminating (SIGTERM) 03:53:48.069726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5420): Terminating (SIGTERM) 03:53:48.112455 --- ParallelTerminationStrategy: PID 5414 died... 03:53:48.133274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5414): Terminated: ok {rc=0} 03:53:48.180291 --- ParallelTerminationStrategy: PID 5417 died... 03:53:48.200376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5417): Terminated: ok {rc=0} 03:53:48.247218 --- ParallelTerminationStrategy: PID 5420 died... 03:53:48.267392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5420): Terminated: ok {rc=0} 03:53:48.356622 bus /sierra_3: Setting Powered False 03:53:49.455246 bus /sierra_3: Setting Powered False 03:53:50.572387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:53:51.823986 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:53:51.831267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:53:51.864788 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:53:51.893409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:53:51.945510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:53:51.979416 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:53:52.006999 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:53:52.558676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:53:52.610720 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:52.622458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:53:52.693739 tst mo_mt_call.py: using LAC 38364 03:53:52.820937 tst mo_mt_call.py: using RAC 114 03:53:52.947945 tst mo_mt_call.py: using CellId 38364 03:53:53.075482 tst mo_mt_call.py: using BVCI 38365 03:53:53.186206 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:53.197443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:53.208429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:53.219419 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:53.230657 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:53:53.241810 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:53.361173 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:53:53.477469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:53:53.944434 run create_hlr_db(pid=5426): Launched 03:53:54.067193 bus /sierra_2: Setting Powered False 03:53:55.126493 run create_hlr_db(pid=5426): Terminated: ok {rc=0} 03:53:55.565463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Launched 03:53:55.888144 run osmo-hlr_10.42.42.2(pid=5429): Launched 03:53:56.010532 run osmo-stp_10.42.42.5: Starting osmo-stp 03:53:56.565609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Launched 03:53:56.888023 run osmo-stp_10.42.42.5(pid=5432): Launched 03:53:57.010434 run osmo-msc_10.42.42.6: Starting osmo-msc 03:53:57.594899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Launched 03:53:57.916084 run osmo-msc_10.42.42.6(pid=5435): Launched 03:53:58.095368 run osmo-stp_10.42.42.5(pid=5432): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] 03:53:58.230578 run osmo-stp_10.42.42.5(pid=5432): stdout: | (launched: 2022-12-14_03:53:56.828815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:58.366449 run osmo-stp_10.42.42.5(pid=5432): stderr: | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035357021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:58.500884 run osmo-stp_10.42.42.5(pid=5432): stdout: | (launched: 2022-12-14_03:53:56.828815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:53:58.628541 run osmo-stp_10.42.42.5(pid=5432): stderr: | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035357020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035357021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035357021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:53:58.781682 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5432): Process ended prematurely: osmo-stp_10.42.42.5(pid=5432) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:53:58.791258 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:53:58.818919 run osmo-hlr_10.42.42.2(pid=5429): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5429)] 03:53:58.869606 run osmo-hlr_10.42.42.2(pid=5429): stdout: | (launched: 2022-12-14_03:53:55.829287) 03:53:58.921326 run osmo-hlr_10.42.42.2(pid=5429): stderr: | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035356026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035356038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035356049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035356049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035356049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:53:58.993891 run osmo-msc_10.42.42.6(pid=5435): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5435)] 03:53:59.043908 run osmo-msc_10.42.42.6(pid=5435): stdout: | (launched: 2022-12-14_03:53:57.856885) 03:53:59.095948 run osmo-msc_10.42.42.6(pid=5435): stderr: | [0;m[38;5;43m20221214035358178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035358178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb4797bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035358178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035358178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035358179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035358179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035358180 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035358181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035358181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035358181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:53:59.148332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Terminating (SIGTERM) 03:53:59.190814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Terminating (SIGTERM) 03:53:59.233594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Terminating (SIGTERM) 03:53:59.276288 --- ParallelTerminationStrategy: PID 5428 died... 03:53:59.296705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5428): Terminated: ok {rc=0} 03:53:59.343844 --- ParallelTerminationStrategy: PID 5431 died... 03:53:59.364062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5431): Terminated: ok {rc=0} 03:53:59.410471 --- ParallelTerminationStrategy: PID 5434 died... 03:53:59.430322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5434): Terminated: ok {rc=0} 03:53:59.518734 bus /sierra_3: Setting Powered False 03:54:00.616845 bus /sierra_3: Setting Powered False 03:54:01.780059 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:54:02.983009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:02.996193 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:54:03.087379 tst mo_mt_call_osmux.py: using LAC 38365 03:54:03.239035 tst mo_mt_call_osmux.py: using RAC 115 03:54:03.384672 tst mo_mt_call_osmux.py: using CellId 38365 03:54:03.564524 tst mo_mt_call_osmux.py: using BVCI 38366 03:54:03.690476 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:03.702273 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:03.713912 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:03.725607 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:03.737461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:54:03.749169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:03.873019 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:54:03.998118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:04.511859 run create_hlr_db(pid=5707): Launched 03:54:04.673790 bus /sierra_2: Setting Powered False 03:54:05.738342 run create_hlr_db(pid=5707): Terminated: ok {rc=0} 03:54:06.198220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Launched 03:54:06.541794 run osmo-hlr_10.42.42.2(pid=5712): Launched 03:54:06.790920 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:07.456142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Launched 03:54:07.799175 run osmo-stp_10.42.42.5(pid=5715): Launched 03:54:08.049555 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:08.731708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5717): Launched 03:54:09.076742 run osmo-msc_10.42.42.6(pid=5718): Launched 03:54:09.440546 run osmo-stp_10.42.42.5(pid=5715): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] 03:54:09.733456 run osmo-stp_10.42.42.5(pid=5715): stdout: | (launched: 2022-12-14_03:54:07.738412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:09.901254 run osmo-stp_10.42.42.5(pid=5715): stderr: | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035408031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:10.043264 run osmo-stp_10.42.42.5(pid=5715): stdout: | (launched: 2022-12-14_03:54:07.738412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:10.178364 run osmo-stp_10.42.42.5(pid=5715): stderr: | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035408030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035408031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035408031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:10.339733 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5715): Process ended prematurely: osmo-stp_10.42.42.5(pid=5715) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:54:10.351726 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 03:54:10.381230 run osmo-hlr_10.42.42.2(pid=5712): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5712)] 03:54:10.436806 run osmo-hlr_10.42.42.2(pid=5712): stdout: | (launched: 2022-12-14_03:54:06.481101) 03:54:10.492416 run osmo-hlr_10.42.42.2(pid=5712): stderr: | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035406786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035406804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035406812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035406813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035406813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:10.569917 run osmo-msc_10.42.42.6(pid=5718): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5718)] 03:54:10.623544 run osmo-msc_10.42.42.6(pid=5718): stdout: | (launched: 2022-12-14_03:54:09.016263) 03:54:10.678866 run osmo-msc_10.42.42.6(pid=5718): stderr: | [0;m[38;5;43m20221214035409510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035409511 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75e2175c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035409511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035409511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035409511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035409511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035409521 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035409522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035409522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035409522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:10.735089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Terminating (SIGTERM) 03:54:10.779692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Terminating (SIGTERM) 03:54:10.826600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5717): Terminating (SIGTERM) 03:54:10.873945 --- ParallelTerminationStrategy: PID 5711 died... 03:54:10.896697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5711): Terminated: ok {rc=0} 03:54:10.949675 --- ParallelTerminationStrategy: PID 5714 died... 03:54:10.970913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5714): Terminated: ok {rc=0} 03:54:11.020491 --- ParallelTerminationStrategy: PID 5717 died... 03:54:11.042287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5717): Terminated: ok {rc=0} 03:54:11.136223 bus /sierra_3: Setting Powered False 03:54:12.241327 bus /sierra_3: Setting Powered False 03:54:13.364538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:54:14.627124 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:14.635365 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:54:14.673694 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:54:14.704258 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:54:14.759966 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:54:14.794942 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:54:14.825083 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:54:15.375935 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:54:15.433675 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:15.446441 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:54:15.520316 tst mo_mt_call.py: using LAC 38366 03:54:15.653852 tst mo_mt_call.py: using RAC 116 03:54:15.789212 tst mo_mt_call.py: using CellId 38366 03:54:15.939228 tst mo_mt_call.py: using BVCI 38367 03:54:16.087206 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:16.099977 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:16.112415 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:16.124855 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:16.138960 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:16.153512 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:16.294048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:16.455064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:17.089713 run create_hlr_db(pid=5723): Launched 03:54:17.279580 bus /sierra_2: Setting Powered False 03:54:18.346721 run create_hlr_db(pid=5723): Terminated: ok {rc=0} 03:54:18.861599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5725): Launched 03:54:19.211273 run osmo-hlr_10.42.42.2(pid=5726): Launched 03:54:19.463099 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:20.143052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5728): Launched 03:54:20.493394 run osmo-stp_10.42.42.5(pid=5729): Launched 03:54:20.747044 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:21.438003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5731): Launched 03:54:21.788477 run osmo-msc_10.42.42.6(pid=5732): Launched 03:54:22.169653 run osmo-stp_10.42.42.5(pid=5729): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5729)] 03:54:22.451885 run osmo-stp_10.42.42.5(pid=5729): stdout: | (launched: 2022-12-14_03:54:20.432462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:22.624327 run osmo-stp_10.42.42.5(pid=5729): stderr: | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035420731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:22.768047 run osmo-stp_10.42.42.5(pid=5729): stdout: | (launched: 2022-12-14_03:54:20.432462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:22.902965 run osmo-stp_10.42.42.5(pid=5729): stderr: | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035420730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035420731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035420731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:23.066987 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5729): Process ended prematurely: osmo-stp_10.42.42.5(pid=5729) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5729)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:54:23.077956 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 03:54:23.107892 run osmo-hlr_10.42.42.2(pid=5726): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5726)] 03:54:23.164808 run osmo-hlr_10.42.42.2(pid=5726): stdout: | (launched: 2022-12-14_03:54:19.150758) 03:54:23.221528 run osmo-hlr_10.42.42.2(pid=5726): stderr: | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035419455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035419474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035419487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035419487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035419487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:23.298471 run osmo-msc_10.42.42.6(pid=5732): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5732)] 03:54:23.354428 run osmo-msc_10.42.42.6(pid=5732): stdout: | (launched: 2022-12-14_03:54:21.726467) 03:54:23.409888 run osmo-msc_10.42.42.6(pid=5732): stderr: | [0;m[38;5;43m20221214035422234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035422234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f117f533c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035422234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035422234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035422235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035422235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035422236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035422237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035422237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035422237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:23.466794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5725): Terminating (SIGTERM) 03:54:23.512062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5728): Terminating (SIGTERM) 03:54:23.561076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5731): Terminating (SIGTERM) 03:54:23.609242 --- ParallelTerminationStrategy: PID 5725 died... 03:54:23.631969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5725): Terminated: ok {rc=0} 03:54:23.684597 --- ParallelTerminationStrategy: PID 5728 died... 03:54:23.706100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5728): Terminated: ok {rc=0} 03:54:23.756662 --- ParallelTerminationStrategy: PID 5731 died... 03:54:23.778680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5731): Terminated: ok {rc=0} 03:54:23.874401 bus /sierra_3: Setting Powered False 03:54:24.977389 bus /sierra_3: Setting Powered False 03:54:26.093969 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:54:27.244229 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.256797 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:54:27.329200 tst mo_mt_call_osmux.py: using LAC 38367 03:54:27.458182 tst mo_mt_call_osmux.py: using RAC 117 03:54:27.585578 tst mo_mt_call_osmux.py: using CellId 38367 03:54:27.707524 tst mo_mt_call_osmux.py: using BVCI 38368 03:54:27.820712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.832089 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.843281 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.854376 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.866126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:54:27.877842 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:27.998909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:54:28.118435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:28.591557 run create_hlr_db(pid=5734): Launched 03:54:28.715345 bus /sierra_2: Setting Powered False 03:54:29.775734 run create_hlr_db(pid=5734): Terminated: ok {rc=0} 03:54:30.199411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5736): Launched 03:54:30.503421 run osmo-hlr_10.42.42.2(pid=5737): Launched 03:54:30.619709 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:31.158141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5739): Launched 03:54:31.481113 run osmo-stp_10.42.42.5(pid=5740): Launched 03:54:31.748665 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:32.428559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5742): Launched 03:54:32.734159 run osmo-msc_10.42.42.6(pid=5743): Launched 03:54:32.906417 run osmo-stp_10.42.42.5(pid=5740): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5740)] 03:54:33.034874 run osmo-stp_10.42.42.5(pid=5740): stdout: | (launched: 2022-12-14_03:54:31.423504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:33.164068 run osmo-stp_10.42.42.5(pid=5740): stderr: | [0;m[38;5;43m20221214035431674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035431675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035431675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035431675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:33.290643 run osmo-stp_10.42.42.5(pid=5740): stdout: | (launched: 2022-12-14_03:54:31.423504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:33.412149 run osmo-stp_10.42.42.5(pid=5740): stderr: | [0;m[38;5;43m20221214035431674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035431675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035431675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035431675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035431676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:33.556298 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5740): Process ended prematurely: osmo-stp_10.42.42.5(pid=5740) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5740)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:54:33.565278 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:54:33.591503 run osmo-hlr_10.42.42.2(pid=5737): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5737)] 03:54:33.638728 run osmo-hlr_10.42.42.2(pid=5737): stdout: | (launched: 2022-12-14_03:54:30.446988) 03:54:33.687673 run osmo-hlr_10.42.42.2(pid=5737): stderr: | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035430625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035430637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035430645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035430645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035430646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:33.755661 run osmo-msc_10.42.42.6(pid=5743): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5743)] 03:54:33.802769 run osmo-msc_10.42.42.6(pid=5743): stdout: | (launched: 2022-12-14_03:54:32.677443) 03:54:33.851415 run osmo-msc_10.42.42.6(pid=5743): stderr: | [0;m[38;5;43m20221214035432951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035432951 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8aefda5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035432951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035432951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035432951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035432951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035432953 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035432954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035432954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035432954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:33.900496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5736): Terminating (SIGTERM) 03:54:33.939534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5739): Terminating (SIGTERM) 03:54:33.978481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5742): Terminating (SIGTERM) 03:54:34.018134 --- ParallelTerminationStrategy: PID 5736 died... 03:54:34.037307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5736): Terminated: ok {rc=0} 03:54:34.081177 --- ParallelTerminationStrategy: PID 5739 died... 03:54:34.099673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5739): Terminated: ok {rc=0} 03:54:34.143198 --- ParallelTerminationStrategy: PID 5742 died... 03:54:34.162215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5742): Terminated: ok {rc=0} 03:54:34.247997 bus /sierra_3: Setting Powered False 03:54:35.347818 bus /sierra_3: Setting Powered False 03:54:36.463222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:54:37.716671 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:37.723128 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:54:37.755873 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:54:37.782401 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:54:37.833311 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:54:37.867489 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:54:37.895488 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:54:38.446645 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:54:38.499913 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:38.511666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:54:38.581518 tst mo_mt_call.py: using LAC 38368 03:54:38.704575 tst mo_mt_call.py: using RAC 118 03:54:38.821825 tst mo_mt_call.py: using CellId 38368 03:54:38.939270 tst mo_mt_call.py: using BVCI 38369 03:54:39.060644 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:39.072440 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:39.084097 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:39.095660 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:39.107830 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:39.119928 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:39.237704 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:39.358421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:39.832614 run create_hlr_db(pid=5748): Launched 03:54:39.957831 bus /sierra_2: Setting Powered False 03:54:41.022700 run create_hlr_db(pid=5748): Terminated: ok {rc=0} 03:54:41.459475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Launched 03:54:41.765985 run osmo-hlr_10.42.42.2(pid=5751): Launched 03:54:41.882081 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:42.407307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Launched 03:54:42.712106 run osmo-stp_10.42.42.5(pid=5754): Launched 03:54:42.827782 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:43.383285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Launched 03:54:43.689497 run osmo-msc_10.42.42.6(pid=5757): Launched 03:54:43.860396 run osmo-stp_10.42.42.5(pid=5754): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] 03:54:43.989989 run osmo-stp_10.42.42.5(pid=5754): stdout: | (launched: 2022-12-14_03:54:42.655320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:44.119075 run osmo-stp_10.42.42.5(pid=5754): stderr: | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035442831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:44.246093 run osmo-stp_10.42.42.5(pid=5754): stdout: | (launched: 2022-12-14_03:54:42.655320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:44.367428 run osmo-stp_10.42.42.5(pid=5754): stderr: | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035442830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035442831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035442831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:44.512315 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5754): Process ended prematurely: osmo-stp_10.42.42.5(pid=5754) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:54:44.521286 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:54:44.547702 run osmo-hlr_10.42.42.2(pid=5751): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5751)] 03:54:44.595770 run osmo-hlr_10.42.42.2(pid=5751): stdout: | (launched: 2022-12-14_03:54:41.708687) 03:54:44.645281 run osmo-hlr_10.42.42.2(pid=5751): stderr: | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035441885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035441897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035441906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035441906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035441906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:44.714253 run osmo-msc_10.42.42.6(pid=5757): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5757)] 03:54:44.761944 run osmo-msc_10.42.42.6(pid=5757): stdout: | (launched: 2022-12-14_03:54:43.632580) 03:54:44.811427 run osmo-msc_10.42.42.6(pid=5757): stderr: | [0;m[38;5;43m20221214035443906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035443906 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0749060c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035443906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035443906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035443907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035443907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035443908 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:44.861032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Terminating (SIGTERM) 03:54:44.900724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Terminating (SIGTERM) 03:54:44.940662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Terminating (SIGTERM) 03:54:44.980813 --- ParallelTerminationStrategy: PID 5750 died... 03:54:44.999974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5750): Terminated: ok {rc=0} 03:54:45.043912 --- ParallelTerminationStrategy: PID 5753 died... 03:54:45.062581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5753): Terminated: ok {rc=0} 03:54:45.106165 --- ParallelTerminationStrategy: PID 5756 died... 03:54:45.124606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5756): Terminated: ok {rc=0} 03:54:45.211065 bus /sierra_3: Setting Powered False 03:54:46.337919 bus /sierra_3: Setting Powered False 03:54:47.466830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:54:48.619587 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:48.631863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:54:48.704577 tst mo_mt_call_osmux.py: using LAC 38369 03:54:48.837755 tst mo_mt_call_osmux.py: using RAC 119 03:54:48.965381 tst mo_mt_call_osmux.py: using CellId 38369 03:54:49.097450 tst mo_mt_call_osmux.py: using BVCI 38370 03:54:49.217058 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:49.228611 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:49.240020 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:49.251332 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:49.263162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:54:49.274962 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:49.394204 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:54:49.515403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:54:50.021358 run create_hlr_db(pid=5759): Launched 03:54:50.147163 bus /sierra_2: Setting Powered False 03:54:51.210928 run create_hlr_db(pid=5759): Terminated: ok {rc=0} 03:54:51.647671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5761): Launched 03:54:51.954486 run osmo-hlr_10.42.42.2(pid=5762): Launched 03:54:52.072194 run osmo-stp_10.42.42.5: Starting osmo-stp 03:54:52.598585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5764): Launched 03:54:52.903433 run osmo-stp_10.42.42.5(pid=5765): Launched 03:54:53.018845 run osmo-msc_10.42.42.6: Starting osmo-msc 03:54:53.570074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5767): Launched 03:54:53.875359 run osmo-msc_10.42.42.6(pid=5768): Launched 03:54:54.045856 run osmo-stp_10.42.42.5(pid=5765): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5765)] 03:54:54.175414 run osmo-stp_10.42.42.5(pid=5765): stdout: | (launched: 2022-12-14_03:54:52.846894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:54.304076 run osmo-stp_10.42.42.5(pid=5765): stderr: | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035453021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:54.430967 run osmo-stp_10.42.42.5(pid=5765): stdout: | (launched: 2022-12-14_03:54:52.846894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:54:54.551619 run osmo-stp_10.42.42.5(pid=5765): stderr: | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035453020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035453021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035453021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:54:54.696406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5765): Process ended prematurely: osmo-stp_10.42.42.5(pid=5765) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5765)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:54:54.705488 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:54:54.732173 run osmo-hlr_10.42.42.2(pid=5762): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5762)] 03:54:54.780129 run osmo-hlr_10.42.42.2(pid=5762): stdout: | (launched: 2022-12-14_03:54:51.896911) 03:54:54.829803 run osmo-hlr_10.42.42.2(pid=5762): stderr: | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035452074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035452086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035452094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035452095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035452095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:54:54.899034 run osmo-msc_10.42.42.6(pid=5768): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5768)] 03:54:54.946896 run osmo-msc_10.42.42.6(pid=5768): stdout: | (launched: 2022-12-14_03:54:53.818655) 03:54:54.997175 run osmo-msc_10.42.42.6(pid=5768): stderr: | [0;m[38;5;43m20221214035454092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035454092 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7bf14a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035454092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035454092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035454096 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035454097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035454097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035454097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:54:55.047303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5761): Terminating (SIGTERM) 03:54:55.087535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5764): Terminating (SIGTERM) 03:54:55.127841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5767): Terminating (SIGTERM) 03:54:55.168249 --- ParallelTerminationStrategy: PID 5761 died... 03:54:55.187662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5761): Terminated: ok {rc=0} 03:54:55.232467 --- ParallelTerminationStrategy: PID 5764 died... 03:54:55.251033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5764): Terminated: ok {rc=0} 03:54:55.295179 --- ParallelTerminationStrategy: PID 5767 died... 03:54:55.314021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5767): Terminated: ok {rc=0} 03:54:55.400367 bus /sierra_3: Setting Powered False 03:54:56.501111 bus /sierra_3: Setting Powered False 03:54:57.617954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:54:58.870324 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:54:58.876565 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:54:58.909377 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:54:58.935931 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:54:58.987297 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:54:59.020151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:54:59.046744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:54:59.598048 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:54:59.646790 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:54:59.658107 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:54:59.726817 tst mo_mt_call.py: using LAC 38370 03:54:59.848528 tst mo_mt_call.py: using RAC 120 03:54:59.968839 tst mo_mt_call.py: using CellId 38370 03:55:00.097917 tst mo_mt_call.py: using BVCI 38371 03:55:00.216851 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:00.228392 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:00.239767 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:00.251375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:00.263316 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:00.275007 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:00.391979 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:00.512808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:01.035544 run create_hlr_db(pid=5773): Launched 03:55:01.196095 bus /sierra_2: Setting Powered False 03:55:02.258245 run create_hlr_db(pid=5773): Terminated: ok {rc=0} 03:55:02.698172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5778): Launched 03:55:03.003399 run osmo-hlr_10.42.42.2(pid=5779): Launched 03:55:03.118929 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:03.645195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5781): Launched 03:55:03.950662 run osmo-stp_10.42.42.5(pid=5782): Launched 03:55:04.068402 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:04.623663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5784): Launched 03:55:04.929045 run osmo-msc_10.42.42.6(pid=5785): Launched 03:55:05.099603 run osmo-stp_10.42.42.5(pid=5782): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5782)] 03:55:05.228349 run osmo-stp_10.42.42.5(pid=5782): stdout: | (launched: 2022-12-14_03:55:03.893300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:05.357324 run osmo-stp_10.42.42.5(pid=5782): stderr: | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035504066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:05.484114 run osmo-stp_10.42.42.5(pid=5782): stdout: | (launched: 2022-12-14_03:55:03.893300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:05.604520 run osmo-stp_10.42.42.5(pid=5782): stderr: | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035504065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035504066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035504066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:05.750102 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5782): Process ended prematurely: osmo-stp_10.42.42.5(pid=5782) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5782)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:55:05.759133 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:55:05.785777 run osmo-hlr_10.42.42.2(pid=5779): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5779)] 03:55:05.833720 run osmo-hlr_10.42.42.2(pid=5779): stdout: | (launched: 2022-12-14_03:55:02.946888) 03:55:05.883023 run osmo-hlr_10.42.42.2(pid=5779): stderr: | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035503123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035503137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035503147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035503147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035503147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:05.952232 run osmo-msc_10.42.42.6(pid=5785): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5785)] 03:55:05.999654 run osmo-msc_10.42.42.6(pid=5785): stdout: | (launched: 2022-12-14_03:55:04.872280) 03:55:06.048758 run osmo-msc_10.42.42.6(pid=5785): stderr: | [0;m[38;5;43m20221214035505146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035505146 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4dc992ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035505146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035505146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035505146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035505146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035505148 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035505149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035505150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035505150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:06.098250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5778): Terminating (SIGTERM) 03:55:06.137502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5781): Terminating (SIGTERM) 03:55:06.176849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5784): Terminating (SIGTERM) 03:55:06.216272 --- ParallelTerminationStrategy: PID 5778 died... 03:55:06.235683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5778): Terminated: ok {rc=0} 03:55:06.279462 --- ParallelTerminationStrategy: PID 5781 died... 03:55:06.298172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5781): Terminated: ok {rc=0} 03:55:06.341928 --- ParallelTerminationStrategy: PID 5784 died... 03:55:06.360666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5784): Terminated: ok {rc=0} 03:55:06.447269 bus /sierra_3: Setting Powered False 03:55:07.547028 bus /sierra_3: Setting Powered False 03:55:08.665072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:55:09.816259 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:09.828760 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:55:09.901527 tst mo_mt_call_osmux.py: using LAC 38371 03:55:10.030455 tst mo_mt_call_osmux.py: using RAC 121 03:55:10.160740 tst mo_mt_call_osmux.py: using CellId 38371 03:55:10.288606 tst mo_mt_call_osmux.py: using BVCI 38372 03:55:10.409427 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:10.421076 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:10.432399 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:10.443777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:10.455650 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:55:10.467338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:10.585190 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:55:10.707292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:11.215414 run create_hlr_db(pid=5787): Launched 03:55:11.340201 bus /sierra_2: Setting Powered False 03:55:12.401548 run create_hlr_db(pid=5787): Terminated: ok {rc=0} 03:55:12.835694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5789): Launched 03:55:13.142498 run osmo-hlr_10.42.42.2(pid=5790): Launched 03:55:13.259373 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:13.787705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5792): Launched 03:55:14.094052 run osmo-stp_10.42.42.5(pid=5793): Launched 03:55:14.210582 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:14.763259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5795): Launched 03:55:15.069475 run osmo-msc_10.42.42.6(pid=5796): Launched 03:55:15.240875 run osmo-stp_10.42.42.5(pid=5793): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5793)] 03:55:15.370557 run osmo-stp_10.42.42.5(pid=5793): stdout: | (launched: 2022-12-14_03:55:14.037314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:15.499796 run osmo-stp_10.42.42.5(pid=5793): stderr: | [0;m[38;5;43m20221214035514207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035514208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035514208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035514208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035514210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035514211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035514211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:15.627656 run osmo-stp_10.42.42.5(pid=5793): stdout: | (launched: 2022-12-14_03:55:14.037314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:15.750054 run osmo-stp_10.42.42.5(pid=5793): stderr: | [0;m[38;5;43m20221214035514207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035514208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035514208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035514208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035514210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035514211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035514211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:15.919128 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5793): Process ended prematurely: osmo-stp_10.42.42.5(pid=5793) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5793)] [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:55:15.930218 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:55:15.960729 run osmo-hlr_10.42.42.2(pid=5790): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5790)] 03:55:16.016254 run osmo-hlr_10.42.42.2(pid=5790): stdout: | (launched: 2022-12-14_03:55:13.085687) 03:55:16.072728 run osmo-hlr_10.42.42.2(pid=5790): stderr: | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035513264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035513277 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035513285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035513286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035513286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:16.152506 run osmo-msc_10.42.42.6(pid=5796): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5796)] 03:55:16.205755 run osmo-msc_10.42.42.6(pid=5796): stdout: | (launched: 2022-12-14_03:55:15.012555) 03:55:16.260934 run osmo-msc_10.42.42.6(pid=5796): stderr: | [0;m[38;5;43m20221214035515285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035515285 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb056973c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035515285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035515285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035515285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035515286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035515287 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035515288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035515288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035515288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:16.317428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5789): Terminating (SIGTERM) 03:55:16.362950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5792): Terminating (SIGTERM) 03:55:16.410266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5795): Terminating (SIGTERM) 03:55:16.457904 --- ParallelTerminationStrategy: PID 5789 died... 03:55:16.480111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5789): Terminated: ok {rc=0} 03:55:16.533791 --- ParallelTerminationStrategy: PID 5792 died... 03:55:16.557372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5792): Terminated: ok {rc=0} 03:55:16.607778 --- ParallelTerminationStrategy: PID 5795 died... 03:55:16.629430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5795): Terminated: ok {rc=0} 03:55:16.729082 bus /sierra_3: Setting Powered False 03:55:17.843729 bus /sierra_3: Setting Powered False 03:55:18.961276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:55:20.212337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:20.218835 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:55:20.251403 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:55:20.279177 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:55:20.331804 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:55:20.364427 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:55:20.391277 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:55:20.946783 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:55:20.996602 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.007888 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:55:21.078864 tst mo_mt_call.py: using LAC 38372 03:55:21.201089 tst mo_mt_call.py: using RAC 122 03:55:21.328476 tst mo_mt_call.py: using CellId 38372 03:55:21.459097 tst mo_mt_call.py: using BVCI 38373 03:55:21.580382 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.592207 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.603920 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.615507 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.627475 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:21.639323 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:21.757640 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:21.878823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:22.386030 run create_hlr_db(pid=5802): Launched 03:55:22.512648 bus /sierra_2: Setting Powered False 03:55:23.576758 run create_hlr_db(pid=5802): Terminated: ok {rc=0} 03:55:24.031964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5804): Launched 03:55:24.360599 run osmo-hlr_10.42.42.2(pid=5805): Launched 03:55:24.487030 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:25.047209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5807): Launched 03:55:25.374832 run osmo-stp_10.42.42.5(pid=5808): Launched 03:55:25.501242 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:26.091053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5810): Launched 03:55:26.418550 run osmo-msc_10.42.42.6(pid=5811): Launched 03:55:26.602674 run osmo-stp_10.42.42.5(pid=5808): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5808)] 03:55:26.741882 run osmo-stp_10.42.42.5(pid=5808): stdout: | (launched: 2022-12-14_03:55:25.315098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:26.880165 run osmo-stp_10.42.42.5(pid=5808): stderr: | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035525508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:27.018489 run osmo-stp_10.42.42.5(pid=5808): stdout: | (launched: 2022-12-14_03:55:25.315098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:27.148293 run osmo-stp_10.42.42.5(pid=5808): stderr: | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035525507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035525508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035525508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:27.304322 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5808): Process ended prematurely: osmo-stp_10.42.42.5(pid=5808) [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5808)] [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:55:27.314197 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:55:27.342201 run osmo-hlr_10.42.42.2(pid=5805): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5805)] 03:55:27.393774 run osmo-hlr_10.42.42.2(pid=5805): stdout: | (launched: 2022-12-14_03:55:24.300203) 03:55:27.446010 run osmo-hlr_10.42.42.2(pid=5805): stderr: | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035524499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035524526 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035524535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035524535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035524535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:27.519244 run osmo-msc_10.42.42.6(pid=5811): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5811)] 03:55:27.569358 run osmo-msc_10.42.42.6(pid=5811): stdout: | (launched: 2022-12-14_03:55:26.358489) 03:55:27.621218 run osmo-msc_10.42.42.6(pid=5811): stderr: | [0;m[38;5;43m20221214035526682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035526682 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7018ec2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035526682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035526683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035526683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035526683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035526685 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035526685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035526685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035526685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:27.673578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5804): Terminating (SIGTERM) 03:55:27.715679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5807): Terminating (SIGTERM) 03:55:27.757895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5810): Terminating (SIGTERM) 03:55:27.800128 --- ParallelTerminationStrategy: PID 5804 died... 03:55:27.820681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5804): Terminated: ok {rc=0} 03:55:27.867634 --- ParallelTerminationStrategy: PID 5807 died... 03:55:27.887729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5807): Terminated: ok {rc=0} 03:55:27.933948 --- ParallelTerminationStrategy: PID 5810 died... 03:55:27.954203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5810): Terminated: ok {rc=0} 03:55:28.043159 bus /sierra_3: Setting Powered False 03:55:29.141430 bus /sierra_3: Setting Powered False 03:55:30.258829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:55:31.417158 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:31.430736 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:55:31.506103 tst mo_mt_call_osmux.py: using LAC 38373 03:55:31.636625 tst mo_mt_call_osmux.py: using RAC 123 03:55:31.767181 tst mo_mt_call_osmux.py: using CellId 38373 03:55:31.889366 tst mo_mt_call_osmux.py: using BVCI 38374 03:55:32.010835 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:32.023715 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:32.036241 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:32.048795 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:32.062599 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:55:32.076498 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:32.204760 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:55:32.329193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:32.837745 run create_hlr_db(pid=5814): Launched 03:55:32.966525 bus /sierra_2: Setting Powered False 03:55:34.032344 run create_hlr_db(pid=5814): Terminated: ok {rc=0} 03:55:34.469581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5816): Launched 03:55:34.778186 run osmo-hlr_10.42.42.2(pid=5817): Launched 03:55:34.895759 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:35.422159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5819): Launched 03:55:35.729664 run osmo-stp_10.42.42.5(pid=5820): Launched 03:55:35.847102 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:36.402547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5823): Launched 03:55:36.709952 run osmo-msc_10.42.42.6(pid=5824): Launched 03:55:36.880905 run osmo-stp_10.42.42.5(pid=5820): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5820)] 03:55:37.009592 run osmo-stp_10.42.42.5(pid=5820): stdout: | (launched: 2022-12-14_03:55:35.672721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:37.138856 run osmo-stp_10.42.42.5(pid=5820): stderr: | [0;m[38;5;43m20221214035535844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035535844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035535845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035535845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:37.265424 run osmo-stp_10.42.42.5(pid=5820): stdout: | (launched: 2022-12-14_03:55:35.672721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:37.386146 run osmo-stp_10.42.42.5(pid=5820): stderr: | [0;m[38;5;43m20221214035535844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035535844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035535845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035535845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035535846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:37.530993 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5820): Process ended prematurely: osmo-stp_10.42.42.5(pid=5820) [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5820)] [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:55:37.539945 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:55:37.566374 run osmo-hlr_10.42.42.2(pid=5817): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5817)] 03:55:37.614606 run osmo-hlr_10.42.42.2(pid=5817): stdout: | (launched: 2022-12-14_03:55:34.721267) 03:55:37.664120 run osmo-hlr_10.42.42.2(pid=5817): stderr: | [0;m[1;31m20221214035534897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035534897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035534897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035534898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035534898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035534898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035534910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035534918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035534918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035534918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:37.733437 run osmo-msc_10.42.42.6(pid=5824): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5824)] 03:55:37.780919 run osmo-msc_10.42.42.6(pid=5824): stdout: | (launched: 2022-12-14_03:55:36.653242) 03:55:37.830264 run osmo-msc_10.42.42.6(pid=5824): stderr: | [0;m[38;5;43m20221214035536926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035536926 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb4777fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035536927 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035536927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035536927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035536927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035536929 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035536929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035536929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035536929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:37.880648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5816): Terminating (SIGTERM) 03:55:37.920042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5819): Terminating (SIGTERM) 03:55:37.959398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5823): Terminating (SIGTERM) 03:55:37.998819 --- ParallelTerminationStrategy: PID 5816 died... 03:55:38.017886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5816): Terminated: ok {rc=0} 03:55:38.061620 --- ParallelTerminationStrategy: PID 5819 died... 03:55:38.080098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5819): Terminated: ok {rc=0} 03:55:38.123702 --- ParallelTerminationStrategy: PID 5823 died... 03:55:38.142159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5823): Terminated: ok {rc=0} 03:55:38.225173 bus /sierra_3: Setting Powered False 03:55:39.319643 bus /sierra_3: Setting Powered False 03:55:40.435422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:55:41.685101 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:55:41.691057 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:55:41.723854 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:55:41.750965 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:55:41.803268 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:55:41.837587 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:55:41.866051 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:55:42.410970 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:55:42.460296 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:42.471439 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:55:42.541476 tst mo_mt_call.py: using LAC 38374 03:55:42.661147 tst mo_mt_call.py: using RAC 124 03:55:42.781138 tst mo_mt_call.py: using CellId 38374 03:55:42.901176 tst mo_mt_call.py: using BVCI 38375 03:55:43.013007 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:43.023893 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:43.034674 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:43.045318 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:43.055990 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:43.066732 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:43.189058 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:43.306658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:43.782590 run create_hlr_db(pid=5829): Launched 03:55:43.910141 bus /sierra_2: Setting Powered False 03:55:44.970797 run create_hlr_db(pid=5829): Terminated: ok {rc=0} 03:55:45.418532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Launched 03:55:45.749195 run osmo-hlr_10.42.42.2(pid=5832): Launched 03:55:45.880891 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:46.565305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Launched 03:55:46.904572 run osmo-stp_10.42.42.5(pid=5835): Launched 03:55:47.098966 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:47.767277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5837): Launched 03:55:48.097629 run osmo-msc_10.42.42.6(pid=5838): Launched 03:55:48.282193 run osmo-stp_10.42.42.5(pid=5835): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] 03:55:48.420535 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-14_03:55:46.846526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:48.559720 run osmo-stp_10.42.42.5(pid=5835): stderr: | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035547189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:48.697333 run osmo-stp_10.42.42.5(pid=5835): stdout: | (launched: 2022-12-14_03:55:46.846526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:48.827716 run osmo-stp_10.42.42.5(pid=5835): stderr: | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035547188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035547189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035547189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:48.984306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:55:48.993901 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 03:55:49.021470 run osmo-hlr_10.42.42.2(pid=5832): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5832)] 03:55:49.072206 run osmo-hlr_10.42.42.2(pid=5832): stdout: | (launched: 2022-12-14_03:55:45.688678) 03:55:49.124586 run osmo-hlr_10.42.42.2(pid=5832): stderr: | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035545973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035545991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035546007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035546008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035546008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:49.197477 run osmo-msc_10.42.42.6(pid=5838): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5838)] 03:55:49.247430 run osmo-msc_10.42.42.6(pid=5838): stdout: | (launched: 2022-12-14_03:55:48.037130) 03:55:49.299317 run osmo-msc_10.42.42.6(pid=5838): stderr: | [0;m[38;5;43m20221214035548362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035548362 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a7d471c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035548362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035548362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035548362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035548362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035548366 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035548366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035548367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035548367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:49.351900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminating (SIGTERM) 03:55:49.394119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminating (SIGTERM) 03:55:49.436081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5837): Terminating (SIGTERM) 03:55:49.478384 --- ParallelTerminationStrategy: PID 5831 died... 03:55:49.498730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5831): Terminated: ok {rc=0} 03:55:49.545234 --- ParallelTerminationStrategy: PID 5834 died... 03:55:49.565241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5834): Terminated: ok {rc=0} 03:55:49.611895 --- ParallelTerminationStrategy: PID 5837 died... 03:55:49.631918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5837): Terminated: ok {rc=0} 03:55:49.720846 bus /sierra_3: Setting Powered False 03:55:50.821284 bus /sierra_3: Setting Powered False 03:55:51.940266 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:55:53.097269 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.109627 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:55:53.183420 tst mo_mt_call_osmux.py: using LAC 38375 03:55:53.313362 tst mo_mt_call_osmux.py: using RAC 125 03:55:53.442606 tst mo_mt_call_osmux.py: using CellId 38375 03:55:53.574660 tst mo_mt_call_osmux.py: using BVCI 38376 03:55:53.695489 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.706992 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.718249 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.729544 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.741208 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:55:53.752758 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:53.875315 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:55:53.993880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:55:54.471307 run create_hlr_db(pid=5843): Launched 03:55:54.597874 bus /sierra_2: Setting Powered False 03:55:55.659170 run create_hlr_db(pid=5843): Terminated: ok {rc=0} 03:55:56.106352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5845): Launched 03:55:56.435504 run osmo-hlr_10.42.42.2(pid=5846): Launched 03:55:56.560927 run osmo-stp_10.42.42.5: Starting osmo-stp 03:55:57.128699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5848): Launched 03:55:57.459009 run osmo-stp_10.42.42.5(pid=5849): Launched 03:55:57.585807 run osmo-msc_10.42.42.6: Starting osmo-msc 03:55:58.179195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5851): Launched 03:55:58.508561 run osmo-msc_10.42.42.6(pid=5852): Launched 03:55:58.692589 run osmo-stp_10.42.42.5(pid=5849): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5849)] 03:55:58.831653 run osmo-stp_10.42.42.5(pid=5849): stdout: | (launched: 2022-12-14_03:55:57.398519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:58.971198 run osmo-stp_10.42.42.5(pid=5849): stderr: | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035557596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:59.109656 run osmo-stp_10.42.42.5(pid=5849): stdout: | (launched: 2022-12-14_03:55:57.398519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:55:59.240186 run osmo-stp_10.42.42.5(pid=5849): stderr: | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035557595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035557596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035557596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:55:59.396672 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5849): Process ended prematurely: osmo-stp_10.42.42.5(pid=5849) [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5849)] [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:55:59.406469 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:55:59.434483 run osmo-hlr_10.42.42.2(pid=5846): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5846)] 03:55:59.485597 run osmo-hlr_10.42.42.2(pid=5846): stdout: | (launched: 2022-12-14_03:55:56.375210) 03:55:59.538257 run osmo-hlr_10.42.42.2(pid=5846): stderr: | [0;m[1;31m20221214035556573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035556573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035556574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035556574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035556574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035556574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035556587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035556596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035556597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035556597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:55:59.611839 run osmo-msc_10.42.42.6(pid=5852): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5852)] 03:55:59.662095 run osmo-msc_10.42.42.6(pid=5852): stdout: | (launched: 2022-12-14_03:55:58.447998) 03:55:59.714759 run osmo-msc_10.42.42.6(pid=5852): stderr: | [0;m[38;5;43m20221214035558773 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035558773 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d3e92ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035558773 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035558773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035558773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035558773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035558775 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035558775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035558776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035558776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:55:59.767552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5845): Terminating (SIGTERM) 03:55:59.809996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5848): Terminating (SIGTERM) 03:55:59.852188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5851): Terminating (SIGTERM) 03:55:59.894756 --- ParallelTerminationStrategy: PID 5845 died... 03:55:59.915153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5845): Terminated: ok {rc=0} 03:55:59.961338 --- ParallelTerminationStrategy: PID 5848 died... 03:55:59.981308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5848): Terminated: ok {rc=0} 03:56:00.027930 --- ParallelTerminationStrategy: PID 5851 died... 03:56:00.047985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5851): Terminated: ok {rc=0} 03:56:00.137784 bus /sierra_3: Setting Powered False 03:56:01.235605 bus /sierra_3: Setting Powered False 03:56:02.355498 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 03:56:03.608922 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:03.614439 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 03:56:03.647502 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 03:56:03.674639 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 03:56:03.726979 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 03:56:03.759378 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 03:56:03.785480 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 03:56:04.334918 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 03:56:04.384803 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.395996 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:56:04.446069 tst mo_mt_call.py: using LAC 38376 03:56:04.566403 tst mo_mt_call.py: using RAC 126 03:56:04.688765 tst mo_mt_call.py: using CellId 38376 03:56:04.813801 tst mo_mt_call.py: using BVCI 38377 03:56:04.926158 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.937384 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.948313 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.959024 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.969748 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:04.984302 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:05.101612 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:05.222680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:05.699232 run create_hlr_db(pid=5857): Launched 03:56:05.824514 bus /sierra_2: Setting Powered False 03:56:06.885507 run create_hlr_db(pid=5857): Terminated: ok {rc=0} 03:56:07.332427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Launched 03:56:07.659953 run osmo-hlr_10.42.42.2(pid=5860): Launched 03:56:07.785624 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:08.352925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Launched 03:56:08.680727 run osmo-stp_10.42.42.5(pid=5863): Launched 03:56:08.806483 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:09.399427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5865): Launched 03:56:09.728152 run osmo-msc_10.42.42.6(pid=5866): Launched 03:56:09.911511 run osmo-stp_10.42.42.5(pid=5863): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] 03:56:10.050415 run osmo-stp_10.42.42.5(pid=5863): stdout: | (launched: 2022-12-14_03:56:08.620261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:10.190626 run osmo-stp_10.42.42.5(pid=5863): stderr: | [0;m[38;5;43m20221214035608814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035608814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035608815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035608815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:10.328530 run osmo-stp_10.42.42.5(pid=5863): stdout: | (launched: 2022-12-14_03:56:08.620261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:10.459071 run osmo-stp_10.42.42.5(pid=5863): stderr: | [0;m[38;5;43m20221214035608814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035608814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035608815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035608815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035608815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:10.614509 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5863): Process ended prematurely: osmo-stp_10.42.42.5(pid=5863) [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 03:56:10.624328 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:56:10.652248 run osmo-hlr_10.42.42.2(pid=5860): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5860)] 03:56:10.703390 run osmo-hlr_10.42.42.2(pid=5860): stdout: | (launched: 2022-12-14_03:56:07.600010) 03:56:10.755808 run osmo-hlr_10.42.42.2(pid=5860): stderr: | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035607802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035607823 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035607833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035607833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035607833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:10.828786 run osmo-msc_10.42.42.6(pid=5866): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5866)] 03:56:10.879032 run osmo-msc_10.42.42.6(pid=5866): stdout: | (launched: 2022-12-14_03:56:09.666869) 03:56:10.930918 run osmo-msc_10.42.42.6(pid=5866): stderr: | [0;m[38;5;43m20221214035609988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035609988 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e22a9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035609988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035609988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035609988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035609989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035609992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035609993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035609993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035609993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:10.983573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Terminating (SIGTERM) 03:56:11.025651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Terminating (SIGTERM) 03:56:11.067949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5865): Terminating (SIGTERM) 03:56:11.110333 --- ParallelTerminationStrategy: PID 5859 died... 03:56:11.130745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5859): Terminated: ok {rc=0} 03:56:11.177253 --- ParallelTerminationStrategy: PID 5862 died... 03:56:11.197146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5862): Terminated: ok {rc=0} 03:56:11.243403 --- ParallelTerminationStrategy: PID 5865 died... 03:56:11.263169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5865): Terminated: ok {rc=0} 03:56:11.350722 bus /sierra_3: Setting Powered False 03:56:12.449847 bus /sierra_3: Setting Powered False 03:56:13.569480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 03:56:14.715523 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:14.727418 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 03:56:14.778828 tst mo_mt_call_osmux.py: using LAC 38377 03:56:14.908725 tst mo_mt_call_osmux.py: using RAC 127 03:56:15.039738 tst mo_mt_call_osmux.py: using CellId 38377 03:56:15.168715 tst mo_mt_call_osmux.py: using BVCI 38378 03:56:15.287600 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:15.299097 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:15.310351 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:15.321577 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:15.333188 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 03:56:15.344729 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:15.462803 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 03:56:15.579876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:16.096527 run create_hlr_db(pid=5868): Launched 03:56:16.260389 bus /sierra_2: Setting Powered False 03:56:17.321644 run create_hlr_db(pid=5868): Terminated: ok {rc=0} 03:56:17.748554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5870): Launched 03:56:18.055193 run osmo-hlr_10.42.42.2(pid=5871): Launched 03:56:18.172087 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:18.717477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5873): Launched 03:56:19.024478 run osmo-stp_10.42.42.5(pid=5874): Launched 03:56:19.140738 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:19.695056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5876): Launched 03:56:20.000370 run osmo-msc_10.42.42.6(pid=5877): Launched 03:56:20.171794 run osmo-stp_10.42.42.5(pid=5874): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5874)] 03:56:20.302184 run osmo-stp_10.42.42.5(pid=5874): stdout: | (launched: 2022-12-14_03:56:18.967571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:20.431614 run osmo-stp_10.42.42.5(pid=5874): stderr: | [0;m[38;5;43m20221214035619140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035619140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035619141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035619141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:20.558985 run osmo-stp_10.42.42.5(pid=5874): stdout: | (launched: 2022-12-14_03:56:18.967571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:20.680485 run osmo-stp_10.42.42.5(pid=5874): stderr: | [0;m[38;5;43m20221214035619140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035619140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035619141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035619141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035619143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:20.825987 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5874): Process ended prematurely: osmo-stp_10.42.42.5(pid=5874) [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5874)] [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 03:56:20.835011 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:56:20.861262 run osmo-hlr_10.42.42.2(pid=5871): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5871)] 03:56:20.909681 run osmo-hlr_10.42.42.2(pid=5871): stdout: | (launched: 2022-12-14_03:56:17.998344) 03:56:20.959116 run osmo-hlr_10.42.42.2(pid=5871): stderr: | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035618179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035618191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035618202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035618202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035618202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:21.027924 run osmo-msc_10.42.42.6(pid=5877): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5877)] 03:56:21.075333 run osmo-msc_10.42.42.6(pid=5877): stdout: | (launched: 2022-12-14_03:56:19.943900) 03:56:21.124454 run osmo-msc_10.42.42.6(pid=5877): stderr: | [0;m[38;5;43m20221214035620219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035620220 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90a1af0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035620220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035620220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035620220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035620220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035620222 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035620222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035620222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035620223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:21.174059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5870): Terminating (SIGTERM) 03:56:21.213150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5873): Terminating (SIGTERM) 03:56:21.252206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5876): Terminating (SIGTERM) 03:56:21.291502 --- ParallelTerminationStrategy: PID 5870 died... 03:56:21.310703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5870): Terminated: ok {rc=0} 03:56:21.354732 --- ParallelTerminationStrategy: PID 5873 died... 03:56:21.373379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5873): Terminated: ok {rc=0} 03:56:21.416826 --- ParallelTerminationStrategy: PID 5876 died... 03:56:21.435246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5876): Terminated: ok {rc=0} 03:56:21.520739 bus /sierra_3: Setting Powered False 03:56:22.621132 bus /sierra_3: Setting Powered False 03:56:23.739447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:56:24.990232 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:24.996231 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:56:25.029282 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:56:25.056306 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:56:25.110806 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:56:25.146588 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:56:25.174662 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:56:25.720626 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:56:25.775627 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:25.787669 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:56:25.842307 tst mo_mt_call.py: using LAC 38378 03:56:25.972298 tst mo_mt_call.py: using RAC 128 03:56:26.101742 tst mo_mt_call.py: using CellId 38378 03:56:26.233716 tst mo_mt_call.py: using BVCI 38379 03:56:26.353499 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:26.365260 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:26.376772 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:26.388309 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:26.400385 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:26.412467 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:26.531395 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:26.655380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:27.165633 run create_hlr_db(pid=5882): Launched 03:56:27.291307 bus /sierra_2: Setting Powered False 03:56:28.356220 run create_hlr_db(pid=5882): Terminated: ok {rc=0} 03:56:28.813497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5884): Launched 03:56:29.143119 run osmo-hlr_10.42.42.2(pid=5885): Launched 03:56:29.268607 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:29.837144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5887): Launched 03:56:30.148476 run osmo-stp_10.42.42.5(pid=5888): Launched 03:56:30.266265 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:30.822220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5890): Launched 03:56:31.183555 run osmo-msc_10.42.42.6(pid=5891): Launched 03:56:31.685588 run osmo-stp_10.42.42.5(pid=5888): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5888)] 03:56:31.836737 run osmo-stp_10.42.42.5(pid=5888): stdout: | (launched: 2022-12-14_03:56:30.091745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:31.979121 run osmo-stp_10.42.42.5(pid=5888): stderr: | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035630264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035630266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035630266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035630267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:32.120878 run osmo-stp_10.42.42.5(pid=5888): stdout: | (launched: 2022-12-14_03:56:30.091745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:32.256887 run osmo-stp_10.42.42.5(pid=5888): stderr: | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035630263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035630264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035630266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035630266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035630267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:32.417337 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5888): Process ended prematurely: osmo-stp_10.42.42.5(pid=5888) [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5888)] [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:56:32.427614 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 03:56:32.455930 run osmo-hlr_10.42.42.2(pid=5885): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5885)] 03:56:32.507555 run osmo-hlr_10.42.42.2(pid=5885): stdout: | (launched: 2022-12-14_03:56:29.082230) 03:56:32.561314 run osmo-hlr_10.42.42.2(pid=5885): stderr: | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035629282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035629294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035629302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035629303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035629303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:32.635163 run osmo-msc_10.42.42.6(pid=5891): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5891)] 03:56:32.686193 run osmo-msc_10.42.42.6(pid=5891): stdout: | (launched: 2022-12-14_03:56:31.120072) 03:56:32.739782 run osmo-msc_10.42.42.6(pid=5891): stderr: | [0;m[38;5;43m20221214035631482 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035631482 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f802edcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035631482 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035631482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035631482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035631484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035631487 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035631487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035631488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035631488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:32.792617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5884): Terminating (SIGTERM) 03:56:32.835563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5887): Terminating (SIGTERM) 03:56:32.878694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5890): Terminating (SIGTERM) 03:56:32.921828 --- ParallelTerminationStrategy: PID 5884 died... 03:56:32.942816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5884): Terminated: ok {rc=0} 03:56:32.990386 --- ParallelTerminationStrategy: PID 5887 died... 03:56:33.010833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5887): Terminated: ok {rc=0} 03:56:33.058014 --- ParallelTerminationStrategy: PID 5890 died... 03:56:33.078453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5890): Terminated: ok {rc=0} 03:56:33.169027 bus /sierra_3: Setting Powered False 03:56:34.268134 bus /sierra_3: Setting Powered False 03:56:35.385273 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:56:36.529372 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:36.541556 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:56:36.594871 tst mo_mt_call_osmux.py: using LAC 38379 03:56:36.716389 tst mo_mt_call_osmux.py: using RAC 129 03:56:36.846533 tst mo_mt_call_osmux.py: using CellId 38379 03:56:36.975693 tst mo_mt_call_osmux.py: using BVCI 38380 03:56:37.086626 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:37.098245 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:37.109631 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:37.121070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:37.132834 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:56:37.144516 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:37.267863 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:56:37.390758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:37.901505 run create_hlr_db(pid=5893): Launched 03:56:38.028618 bus /sierra_2: Setting Powered False 03:56:39.093057 run create_hlr_db(pid=5893): Terminated: ok {rc=0} 03:56:39.548009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5895): Launched 03:56:39.876154 run osmo-hlr_10.42.42.2(pid=5896): Launched 03:56:40.001900 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:40.531229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5898): Launched 03:56:40.836482 run osmo-stp_10.42.42.5(pid=5899): Launched 03:56:40.952800 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:41.504189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5901): Launched 03:56:41.809970 run osmo-msc_10.42.42.6(pid=5902): Launched 03:56:41.980844 run osmo-stp_10.42.42.5(pid=5899): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5899)] 03:56:42.109947 run osmo-stp_10.42.42.5(pid=5899): stdout: | (launched: 2022-12-14_03:56:40.779981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:42.239376 run osmo-stp_10.42.42.5(pid=5899): stderr: | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035640952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:42.366121 run osmo-stp_10.42.42.5(pid=5899): stdout: | (launched: 2022-12-14_03:56:40.779981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:42.487749 run osmo-stp_10.42.42.5(pid=5899): stderr: | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035640951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035640952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035640952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:42.632146 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5899): Process ended prematurely: osmo-stp_10.42.42.5(pid=5899) [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5899)] [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:56:42.641154 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:56:42.667448 run osmo-hlr_10.42.42.2(pid=5896): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5896)] 03:56:42.714844 run osmo-hlr_10.42.42.2(pid=5896): stdout: | (launched: 2022-12-14_03:56:39.815592) 03:56:42.763689 run osmo-hlr_10.42.42.2(pid=5896): stderr: | [0;m[1;31m20221214035640016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035640016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035640016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035640016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035640017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035640017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035640032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035640040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035640041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035640041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:42.832080 run osmo-msc_10.42.42.6(pid=5902): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5902)] 03:56:42.879227 run osmo-msc_10.42.42.6(pid=5902): stdout: | (launched: 2022-12-14_03:56:41.753251) 03:56:42.928580 run osmo-msc_10.42.42.6(pid=5902): stderr: | [0;m[38;5;43m20221214035642025 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035642026 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa602ab3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035642026 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035642026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035642026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035642026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035642028 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035642028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035642028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035642028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:42.977977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5895): Terminating (SIGTERM) 03:56:43.017437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5898): Terminating (SIGTERM) 03:56:43.056733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5901): Terminating (SIGTERM) 03:56:43.096329 --- ParallelTerminationStrategy: PID 5895 died... 03:56:43.115544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5895): Terminated: ok {rc=0} 03:56:43.159246 --- ParallelTerminationStrategy: PID 5898 died... 03:56:43.177910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5898): Terminated: ok {rc=0} 03:56:43.221351 --- ParallelTerminationStrategy: PID 5901 died... 03:56:43.239944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5901): Terminated: ok {rc=0} 03:56:43.326160 bus /sierra_3: Setting Powered False 03:56:44.425440 bus /sierra_3: Setting Powered False 03:56:45.537310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:trx-b200 --------------------------------------------------------------------- 03:56:46.832576 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:56:46.841080 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 03:56:46.890527 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 03:56:46.922034 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 03:56:47.032269 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 03:56:47.080303 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 03:56:47.119692 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 03:56:47.674969 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 03:56:47.681112 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:47.692331 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:56:47.744448 tst emergency_mo_mt_call.py: using LAC 38380 03:56:47.864174 tst emergency_mo_mt_call.py: using RAC 130 03:56:47.984329 tst emergency_mo_mt_call.py: using CellId 38380 03:56:48.105053 tst emergency_mo_mt_call.py: using BVCI 38381 03:56:48.214746 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:48.225604 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:48.236082 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:48.246553 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:48.256911 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:48.267938 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:48.389574 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:48.509232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:49.006575 run create_hlr_db(pid=5907): Launched 03:56:49.131555 bus /sierra_2: Setting Powered False 03:56:50.196237 run create_hlr_db(pid=5907): Terminated: ok {rc=0} 03:56:50.627372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5909): Launched 03:56:50.930370 run osmo-hlr_10.42.42.2(pid=5910): Launched 03:56:51.043792 run osmo-stp_10.42.42.5: Starting osmo-stp 03:56:51.568096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5912): Launched 03:56:51.868890 run osmo-stp_10.42.42.5(pid=5913): Launched 03:56:51.995460 tst emergency_mo_mt_call.py: using MSISDN 8494 03:56:52.148212 run osmo-msc_10.42.42.6: Starting osmo-msc 03:56:52.689228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5915): Launched 03:56:52.989867 run osmo-msc_10.42.42.6(pid=5916): Launched 03:56:53.157788 run osmo-stp_10.42.42.5(pid=5913): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5913)] 03:56:53.284808 run osmo-stp_10.42.42.5(pid=5913): stdout: | (launched: 2022-12-14_03:56:51.813214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:53.412382 run osmo-stp_10.42.42.5(pid=5913): stderr: | [0;m[38;5;43m20221214035651986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035651986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035651987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035651988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035651988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035651989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035651989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:53.537524 run osmo-stp_10.42.42.5(pid=5913): stdout: | (launched: 2022-12-14_03:56:51.813214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:56:53.656426 run osmo-stp_10.42.42.5(pid=5913): stderr: | [0;m[38;5;43m20221214035651986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035651986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035651987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035651988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035651988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035651989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035651989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:56:53.798830 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5913): Process ended prematurely: osmo-stp_10.42.42.5(pid=5913) [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5913)] [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 03:56:53.807040 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 03:56:53.832992 run osmo-hlr_10.42.42.2(pid=5910): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5910)] 03:56:53.880370 run osmo-hlr_10.42.42.2(pid=5910): stdout: | (launched: 2022-12-14_03:56:50.874187) 03:56:53.929478 run osmo-hlr_10.42.42.2(pid=5910): stderr: | [0;m[1;31m20221214035651050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035651050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035651050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035651051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035651051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035651051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035651063 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035651072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035651072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035651072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:56:53.997911 run osmo-msc_10.42.42.6(pid=5916): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5916)] 03:56:54.045437 run osmo-msc_10.42.42.6(pid=5916): stdout: | (launched: 2022-12-14_03:56:52.934000) 03:56:54.094660 run osmo-msc_10.42.42.6(pid=5916): stderr: | [0;m[38;5;43m20221214035653206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035653207 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f397304ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035653207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035653207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035653207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035653207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035653209 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035653209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035653210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035653210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:56:54.144050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5909): Terminating (SIGTERM) 03:56:54.183251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5912): Terminating (SIGTERM) 03:56:54.222712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5915): Terminating (SIGTERM) 03:56:54.262170 --- ParallelTerminationStrategy: PID 5909 died... 03:56:54.281356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5909): Terminated: ok {rc=0} 03:56:54.325498 --- ParallelTerminationStrategy: PID 5912 died... 03:56:54.344078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5912): Terminated: ok {rc=0} 03:56:54.387948 --- ParallelTerminationStrategy: PID 5915 died... 03:56:54.406764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5915): Terminated: ok {rc=0} 03:56:54.490757 bus /sierra_3: Setting Powered False 03:56:55.590280 bus /sierra_3: Setting Powered False 03:56:56.707951 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 03:56:57.795276 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:57.807418 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 03:56:57.861883 tst emergency_preemptive_call.py: using LAC 38381 03:56:57.989374 tst emergency_preemptive_call.py: using RAC 131 03:56:58.116662 tst emergency_preemptive_call.py: using CellId 38381 03:56:58.242785 tst emergency_preemptive_call.py: using BVCI 38382 03:56:58.361405 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:58.372557 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:58.383576 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:58.394500 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:58.405781 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 03:56:58.417129 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:58.535861 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:58.655714 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:58.772209 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 03:56:58.888842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:56:59.354563 run create_hlr_db(pid=5918): Launched 03:56:59.479531 bus /sierra_2: Setting Powered False 03:57:00.540020 run create_hlr_db(pid=5918): Terminated: ok {rc=0} 03:57:00.993747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5920): Launched 03:57:01.341380 run osmo-hlr_10.42.42.2(pid=5921): Launched 03:57:01.579963 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:02.225129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5923): Launched 03:57:02.560243 run osmo-stp_10.42.42.5(pid=5924): Launched 03:57:02.693112 tst emergency_preemptive_call.py: using MSISDN 8495 03:57:02.864657 run osmo-msc_10.42.42.6: Starting osmo-msc 03:57:03.444062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5926): Launched 03:57:03.768778 run osmo-msc_10.42.42.6(pid=5927): Launched 03:57:03.950590 run osmo-stp_10.42.42.5(pid=5924): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5924)] 03:57:04.086769 run osmo-stp_10.42.42.5(pid=5924): stdout: | (launched: 2022-12-14_03:57:02.500334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:04.222987 run osmo-stp_10.42.42.5(pid=5924): stderr: | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035702693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:04.359457 run osmo-stp_10.42.42.5(pid=5924): stdout: | (launched: 2022-12-14_03:57:02.500334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:04.487651 run osmo-stp_10.42.42.5(pid=5924): stderr: | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035702692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035702693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035702695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:04.641340 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5924): Process ended prematurely: osmo-stp_10.42.42.5(pid=5924) [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5924)] [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py:32] 03:57:04.650767 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 03:57:04.678874 run osmo-hlr_10.42.42.2(pid=5921): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5921)] 03:57:04.731115 run osmo-hlr_10.42.42.2(pid=5921): stdout: | (launched: 2022-12-14_03:57:01.280475) 03:57:04.784499 run osmo-hlr_10.42.42.2(pid=5921): stderr: | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035701606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035701620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035701628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035701628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035701628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:04.858392 run osmo-msc_10.42.42.6(pid=5927): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5927)] 03:57:04.909412 run osmo-msc_10.42.42.6(pid=5927): stdout: | (launched: 2022-12-14_03:57:03.708910) 03:57:04.962820 run osmo-msc_10.42.42.6(pid=5927): stderr: | [0;m[38;5;43m20221214035704031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214035704031 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f137dc80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214035704031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214035704031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214035704031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214035704031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214035704033 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214035704033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214035704034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214035704034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:57:05.015684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5920): Terminating (SIGTERM) 03:57:05.058498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5923): Terminating (SIGTERM) 03:57:05.101711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5926): Terminating (SIGTERM) 03:57:05.144713 --- ParallelTerminationStrategy: PID 5920 died... 03:57:05.165578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5920): Terminated: ok {rc=0} 03:57:05.213125 --- ParallelTerminationStrategy: PID 5923 died... 03:57:05.233596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5923): Terminated: ok {rc=0} 03:57:05.280366 --- ParallelTerminationStrategy: PID 5926 died... 03:57:05.300743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5926): Terminated: ok {rc=0} 03:57:05.390697 bus /sierra_9: Setting Powered False 03:57:06.490481 bus /sierra_9: Setting Powered False 03:57:07.607821 bus /sierra_8: Setting Powered False 03:57:08.704753 bus /sierra_8: Setting Powered False 03:57:09.818266 bus /sierra_3: Setting Powered False 03:57:10.917950 bus /sierra_3: Setting Powered False 03:57:12.035175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-b200 --------------------------------------------------------------------- 03:57:13.316728 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:57:13.321396 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 03:57:13.354156 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 03:57:13.392022 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 03:57:13.478394 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 03:57:13.511012 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 03:57:13.549290 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 03:57:14.138649 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 03:57:14.188281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.198892 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:14.247413 tst cs_paging_gprs_active.py: using LAC 38382 03:57:14.378356 tst cs_paging_gprs_active.py: using RAC 132 03:57:14.506896 tst cs_paging_gprs_active.py: using CellId 38382 03:57:14.636599 tst cs_paging_gprs_active.py: using BVCI 38383 03:57:14.758586 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.769905 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.780878 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.792128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.803650 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.815088 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.826734 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.838200 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:14.849894 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:14.969494 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:15.086542 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:57:15.292042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:15.600371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5932): Launched 03:57:15.885774 run iperf3-srv_10.42.42.10(pid=5933): Launched 03:57:16.028384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:57:16.276426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:16.617947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5934): Launched 03:57:16.921109 run iperf3-srv_10.42.42.10(pid=5935): Launched 03:57:17.056468 tst cs_paging_gprs_active.py:38: start network... 03:57:17.283115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:17.793419 run create_hlr_db(pid=5936): Launched 03:57:17.918619 bus /sierra_2: Setting Powered False 03:57:18.983185 run create_hlr_db(pid=5936): Terminated: ok {rc=0} 03:57:19.439651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Launched 03:57:19.771038 run osmo-hlr_10.42.42.2(pid=5939): Launched 03:57:19.897737 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:20.463396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Launched 03:57:20.795282 run osmo-stp_10.42.42.5(pid=5942): Launched 03:57:20.921862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:21.492120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5944): Launched 03:57:21.619889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:21.899165 run patchelf(pid=5945): Launched 03:57:22.083684 run osmo-stp_10.42.42.5(pid=5942): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] 03:57:22.223791 run osmo-stp_10.42.42.5(pid=5942): stdout: | (launched: 2022-12-14_03:57:20.734202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:22.364403 run osmo-stp_10.42.42.5(pid=5942): stderr: | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035720929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:22.504880 run osmo-stp_10.42.42.5(pid=5942): stdout: | (launched: 2022-12-14_03:57:20.734202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:22.639781 run osmo-stp_10.42.42.5(pid=5942): stderr: | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035720928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035720929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035720929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:22.800361 run patchelf(pid=5945): Terminating (SIGINT) 03:57:22.983596 run patchelf(pid=5945): Terminated: ok {rc=0} 03:57:23.116221 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5942): Process ended prematurely: osmo-stp_10.42.42.5(pid=5942) [trial-2399↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] [trial-2399↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 03:57:23.126646 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 03:57:23.155448 run osmo-hlr_10.42.42.2(pid=5939): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5939)] 03:57:23.206508 run osmo-hlr_10.42.42.2(pid=5939): stdout: | (launched: 2022-12-14_03:57:19.710465) 03:57:23.258974 run osmo-hlr_10.42.42.2(pid=5939): stderr: | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035719910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035719923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035719931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035719931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035719931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:23.311756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5932): Terminating (SIGTERM) 03:57:23.354368 run iperf3-srv_10.42.42.10(pid=5933): Terminating (SIGTERM) 03:57:23.396865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5934): Terminating (SIGTERM) 03:57:23.440598 run iperf3-srv_10.42.42.10(pid=5935): Terminating (SIGTERM) 03:57:23.483228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Terminating (SIGTERM) 03:57:23.526115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Terminating (SIGTERM) 03:57:23.568867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5944): Terminating (SIGTERM) 03:57:23.611483 --- ParallelTerminationStrategy: PID 5932 died... 03:57:23.631986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5932): Terminated: ok {rc=0} 03:57:23.678697 --- ParallelTerminationStrategy: PID 5933 died... 03:57:23.698674 run iperf3-srv_10.42.42.10(pid=5933): Terminated {rc=256} 03:57:23.745438 --- ParallelTerminationStrategy: PID 5934 died... 03:57:23.765353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5934): Terminated: ok {rc=0} 03:57:23.812084 --- ParallelTerminationStrategy: PID 5935 died... 03:57:23.832054 run iperf3-srv_10.42.42.10(pid=5935): Terminated {rc=256} 03:57:23.878495 --- ParallelTerminationStrategy: PID 5938 died... 03:57:23.898459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Terminated: ok {rc=0} 03:57:23.944791 --- ParallelTerminationStrategy: PID 5941 died... 03:57:23.965343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Terminated: ok {rc=0} 03:57:24.011898 --- ParallelTerminationStrategy: PID 5944 died... 03:57:24.031797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5944): Terminated: ok {rc=0} 03:57:24.121004 bus /gobi_0: Setting Powered False 03:57:25.221048 bus /gobi_0: Setting Powered False 03:57:26.338035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200 iperf3.py ---------------------------------------------- 03:57:27.488022 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:27.499920 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:27.553753 tst iperf3.py: using LAC 38383 03:57:27.676738 tst iperf3.py: using RAC 133 03:57:27.800454 tst iperf3.py: using CellId 38383 03:57:27.922655 tst iperf3.py: using BVCI 38384 03:57:28.035947 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.046938 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.057671 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.068370 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.078871 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.090692 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.101980 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.113184 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:28.124389 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:28.241647 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:28.446900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:28.754813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Launched 03:57:29.024305 run iperf3-srv_10.42.42.10(pid=5948): Launched 03:57:29.140134 tst iperf3.py:8: start network... 03:57:29.346125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:29.820847 run create_hlr_db(pid=5949): Launched 03:57:29.945969 bus /gobi_6: Setting Powered False 03:57:31.012561 run create_hlr_db(pid=5949): Terminated: ok {rc=0} 03:57:31.481750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Launched 03:57:31.898945 run osmo-hlr_10.42.42.2(pid=5952): Launched 03:57:32.113093 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:32.726137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5954): Launched 03:57:33.057271 run osmo-stp_10.42.42.5(pid=5955): Launched 03:57:33.183199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:33.748660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5957): Launched 03:57:33.874199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:34.151457 run patchelf(pid=5958): Launched 03:57:34.335785 run osmo-stp_10.42.42.5(pid=5955): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5955)] 03:57:34.475205 run osmo-stp_10.42.42.5(pid=5955): stdout: | (launched: 2022-12-14_03:57:32.996896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:34.616101 run osmo-stp_10.42.42.5(pid=5955): stderr: | [0;m[38;5;43m20221214035733189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035733189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035733190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035733190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:34.756820 run osmo-stp_10.42.42.5(pid=5955): stdout: | (launched: 2022-12-14_03:57:32.996896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:34.892516 run osmo-stp_10.42.42.5(pid=5955): stderr: | [0;m[38;5;43m20221214035733189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035733189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035733190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035733190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035733191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:35.052233 run patchelf(pid=5958): Terminating (SIGINT) 03:57:35.235290 run patchelf(pid=5958): Terminated: ok {rc=0} 03:57:35.367669 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5955): Process ended prematurely: osmo-stp_10.42.42.5(pid=5955) [trial-2399↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5955)] [trial-2399↪gprs:trx-b200↪iperf3.py:8] 03:57:35.378273 tst iperf3.py:8: Test FAILED (7.9 sec) 03:57:35.406978 run osmo-hlr_10.42.42.2(pid=5952): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5952)] 03:57:35.457781 run osmo-hlr_10.42.42.2(pid=5952): stdout: | (launched: 2022-12-14_03:57:31.832924) 03:57:35.509942 run osmo-hlr_10.42.42.2(pid=5952): stderr: | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035732099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035732127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035732151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035732151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035732151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:35.562586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Terminating (SIGTERM) 03:57:35.604901 run iperf3-srv_10.42.42.10(pid=5948): Terminating (SIGTERM) 03:57:35.647106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Terminating (SIGTERM) 03:57:35.690071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5954): Terminating (SIGTERM) 03:57:35.732744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5957): Terminating (SIGTERM) 03:57:35.776034 --- ParallelTerminationStrategy: PID 5947 died... 03:57:35.796594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5947): Terminated: ok {rc=0} 03:57:35.843615 --- ParallelTerminationStrategy: PID 5948 died... 03:57:35.863534 run iperf3-srv_10.42.42.10(pid=5948): Terminated {rc=256} 03:57:35.909891 --- ParallelTerminationStrategy: PID 5951 died... 03:57:35.929827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5951): Terminated: ok {rc=0} 03:57:35.976115 --- ParallelTerminationStrategy: PID 5954 died... 03:57:35.995981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5954): Terminated: ok {rc=0} 03:57:36.042261 --- ParallelTerminationStrategy: PID 5957 died... 03:57:36.062168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5957): Terminated: ok {rc=0} 03:57:36.151228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 03:57:37.302461 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.314498 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:37.366628 tst iperf3m4.py: using LAC 38384 03:57:37.489523 tst iperf3m4.py: using RAC 134 03:57:37.614051 tst iperf3m4.py: using CellId 38384 03:57:37.734718 tst iperf3m4.py: using BVCI 38385 03:57:37.852930 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.863607 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.874098 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.884801 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.895065 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.905868 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.916661 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.927465 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:37.939365 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:38.061862 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:38.181916 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:38.302018 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:38.420531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:57:38.625396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:38.933935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5959): Launched 03:57:39.203974 run iperf3-srv_10.42.42.10(pid=5960): Launched 03:57:39.319372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:57:39.524013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:39.832139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Launched 03:57:40.111591 run iperf3-srv_10.42.42.10(pid=5962): Launched 03:57:40.236211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:57:40.457979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:40.788129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Launched 03:57:41.075445 run iperf3-srv_10.42.42.10(pid=5964): Launched 03:57:41.199708 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:57:41.419267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:57:41.748208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5965): Launched 03:57:42.035105 run iperf3-srv_10.42.42.10(pid=5966): Launched 03:57:42.160066 tst iperf3m4.py:8: start network... 03:57:42.380857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:42.891263 run create_hlr_db(pid=5967): Launched 03:57:43.019348 bus /gobi_6: Setting Powered False 03:57:44.084583 run create_hlr_db(pid=5967): Terminated: ok {rc=0} 03:57:44.540751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5969): Launched 03:57:44.869682 run osmo-hlr_10.42.42.2(pid=5970): Launched 03:57:44.996523 run osmo-stp_10.42.42.5: Starting osmo-stp 03:57:45.564997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5972): Launched 03:57:45.904673 run osmo-stp_10.42.42.5(pid=5973): Launched 03:57:46.106977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:57:46.929096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5975): Launched 03:57:47.058728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:57:47.326363 run patchelf(pid=5976): Launched 03:57:47.497312 run osmo-stp_10.42.42.5(pid=5973): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5973)] 03:57:47.626902 run osmo-stp_10.42.42.5(pid=5973): stdout: | (launched: 2022-12-14_03:57:45.833384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:47.758592 run osmo-stp_10.42.42.5(pid=5973): stderr: | [0;m[38;5;43m20221214035746188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035746189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035746191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035746193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:47.889345 run osmo-stp_10.42.42.5(pid=5973): stdout: | (launched: 2022-12-14_03:57:45.833384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:57:48.014485 run osmo-stp_10.42.42.5(pid=5973): stderr: | [0;m[38;5;43m20221214035746188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035746189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035746191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035746193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035746196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:57:48.163019 run patchelf(pid=5976): Terminating (SIGINT) 03:57:48.333641 run patchelf(pid=5976): Terminated: ok {rc=0} 03:57:48.456686 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5973): Process ended prematurely: osmo-stp_10.42.42.5(pid=5973) [trial-2399↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5973)] [trial-2399↪gprs:trx-b200↪iperf3m4.py:8] 03:57:48.466378 tst iperf3m4.py:8: Test FAILED (11.2 sec) 03:57:48.493812 run osmo-hlr_10.42.42.2(pid=5970): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5970)] 03:57:48.541203 run osmo-hlr_10.42.42.2(pid=5970): stdout: | (launched: 2022-12-14_03:57:44.809316) 03:57:48.590346 run osmo-hlr_10.42.42.2(pid=5970): stderr: | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035745008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035745020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035745029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035745029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035745029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:57:48.639925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5959): Terminating (SIGTERM) 03:57:48.679312 run iperf3-srv_10.42.42.10(pid=5960): Terminating (SIGTERM) 03:57:48.718689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminating (SIGTERM) 03:57:48.758372 run iperf3-srv_10.42.42.10(pid=5962): Terminating (SIGTERM) 03:57:48.798349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Terminating (SIGTERM) 03:57:48.837955 run iperf3-srv_10.42.42.10(pid=5964): Terminating (SIGTERM) 03:57:48.877484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5965): Terminating (SIGTERM) 03:57:48.917596 run iperf3-srv_10.42.42.10(pid=5966): Terminating (SIGTERM) 03:57:48.957609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5969): Terminating (SIGTERM) 03:57:48.997422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5972): Terminating (SIGTERM) 03:57:49.037210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5975): Terminating (SIGTERM) 03:57:49.077787 --- ParallelTerminationStrategy: PID 5959 died... 03:57:49.096925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5959): Terminated: ok {rc=0} 03:57:49.141373 --- ParallelTerminationStrategy: PID 5960 died... 03:57:49.160123 run iperf3-srv_10.42.42.10(pid=5960): Terminated {rc=256} 03:57:49.203969 --- ParallelTerminationStrategy: PID 5961 died... 03:57:49.222649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5961): Terminated: ok {rc=0} 03:57:49.266523 --- ParallelTerminationStrategy: PID 5962 died... 03:57:49.285240 run iperf3-srv_10.42.42.10(pid=5962): Terminated {rc=256} 03:57:49.329090 --- ParallelTerminationStrategy: PID 5963 died... 03:57:49.347767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5963): Terminated: ok {rc=0} 03:57:49.391662 --- ParallelTerminationStrategy: PID 5964 died... 03:57:49.410255 run iperf3-srv_10.42.42.10(pid=5964): Terminated {rc=256} 03:57:49.453920 --- ParallelTerminationStrategy: PID 5965 died... 03:57:49.472484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5965): Terminated: ok {rc=0} 03:57:49.516153 --- ParallelTerminationStrategy: PID 5966 died... 03:57:49.534827 run iperf3-srv_10.42.42.10(pid=5966): Terminated {rc=256} 03:57:49.578389 --- ParallelTerminationStrategy: PID 5969 died... 03:57:49.597096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5969): Terminated: ok {rc=0} 03:57:49.640895 --- ParallelTerminationStrategy: PID 5972 died... 03:57:49.660090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5972): Terminated: ok {rc=0} 03:57:49.703989 --- ParallelTerminationStrategy: PID 5975 died... 03:57:49.722935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5975): Terminated: ok {rc=0} 03:57:49.810752 bus /gobi_4: Setting Powered False 03:57:50.911147 bus /gobi_4: Setting Powered False 03:57:52.024608 bus /gobi_1: Setting Powered False 03:57:53.123487 bus /gobi_1: Setting Powered False 03:57:54.242017 bus /gobi_0: Setting Powered False 03:57:55.341776 bus /gobi_0: Setting Powered False 03:57:56.460919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200 ping.py ---------------------------------------------- 03:57:57.565695 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:57.577843 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:57:57.628237 tst ping.py: using LAC 38385 03:57:57.756740 tst ping.py: using RAC 135 03:57:57.883980 tst ping.py: using CellId 38385 03:57:58.008905 tst ping.py: using BVCI 38386 03:57:58.126505 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.137712 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.148686 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.159670 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.170861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.182060 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.193372 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:57:58.204706 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:57:58.321475 tst ping.py:19: start network... 03:57:58.523214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:57:58.988450 run create_hlr_db(pid=5977): Launched 03:57:59.111597 bus /gobi_6: Setting Powered False 03:58:00.172212 run create_hlr_db(pid=5977): Terminated: ok {rc=0} 03:58:00.591175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5979): Launched 03:58:00.916563 run osmo-hlr_10.42.42.2(pid=5980): Launched 03:58:01.142401 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:01.806635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5982): Launched 03:58:02.154008 run osmo-stp_10.42.42.5(pid=5983): Launched 03:58:02.290230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:02.828752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5985): Launched 03:58:02.943616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:03.198419 run patchelf(pid=5986): Launched 03:58:03.367659 run osmo-stp_10.42.42.5(pid=5983): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5983)] 03:58:03.494663 run osmo-stp_10.42.42.5(pid=5983): stdout: | (launched: 2022-12-14_03:58:02.090159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:03.624002 run osmo-stp_10.42.42.5(pid=5983): stderr: | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035802385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035802388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035802388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:03.753371 run osmo-stp_10.42.42.5(pid=5983): stdout: | (launched: 2022-12-14_03:58:02.090159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:03.876396 run osmo-stp_10.42.42.5(pid=5983): stderr: | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035802385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035802385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035802387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035802388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035802388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:04.022309 run patchelf(pid=5986): Terminating (SIGINT) 03:58:04.189980 run patchelf(pid=5986): Terminated: ok {rc=0} 03:58:04.310776 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5983): Process ended prematurely: osmo-stp_10.42.42.5(pid=5983) [trial-2399↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5983)] [trial-2399↪gprs:trx-b200↪ping.py:22] 03:58:04.319701 tst ping.py:22: Test FAILED (6.7 sec) 03:58:04.346634 run osmo-hlr_10.42.42.2(pid=5980): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5980)] 03:58:04.394575 run osmo-hlr_10.42.42.2(pid=5980): stdout: | (launched: 2022-12-14_03:58:00.835994) 03:58:04.444238 run osmo-hlr_10.42.42.2(pid=5980): stderr: | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035801200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035801240 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035801248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035801253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035801253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:04.494375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5979): Terminating (SIGTERM) 03:58:04.534298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5982): Terminating (SIGTERM) 03:58:04.574012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5985): Terminating (SIGTERM) 03:58:04.613880 --- ParallelTerminationStrategy: PID 5979 died... 03:58:04.633221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5979): Terminated: ok {rc=0} 03:58:04.677539 --- ParallelTerminationStrategy: PID 5982 died... 03:58:04.696211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5982): Terminated: ok {rc=0} 03:58:04.740499 --- ParallelTerminationStrategy: PID 5985 died... 03:58:04.759278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5985): Terminated: ok {rc=0} 03:58:04.846685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 03:58:05.936152 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:05.947495 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 03:58:05.998255 tst ping_idle_ping.py: using LAC 38386 03:58:06.119321 tst ping_idle_ping.py: using RAC 136 03:58:06.240426 tst ping_idle_ping.py: using CellId 38386 03:58:06.359281 tst ping_idle_ping.py: using BVCI 38387 03:58:06.470706 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.481476 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.491883 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.502336 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.512642 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.523434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.534565 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 03:58:06.545599 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 03:58:06.662521 tst ping_idle_ping.py:24: start network... 03:58:06.863346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:07.333224 run create_hlr_db(pid=5987): Launched 03:58:07.457494 bus /gobi_6: Setting Powered False 03:58:08.517544 run create_hlr_db(pid=5987): Terminated: ok {rc=0} 03:58:08.959231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5989): Launched 03:58:09.282934 run osmo-hlr_10.42.42.2(pid=5990): Launched 03:58:09.409512 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:09.964544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5992): Launched 03:58:10.289306 run osmo-stp_10.42.42.5(pid=5993): Launched 03:58:10.414149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:10.971222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5995): Launched 03:58:11.096616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:11.370904 run patchelf(pid=5996): Launched 03:58:11.551551 run osmo-stp_10.42.42.5(pid=5993): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5993)] 03:58:11.689337 run osmo-stp_10.42.42.5(pid=5993): stdout: | (launched: 2022-12-14_03:58:10.229548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:11.829127 run osmo-stp_10.42.42.5(pid=5993): stderr: | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035810423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:11.968046 run osmo-stp_10.42.42.5(pid=5993): stdout: | (launched: 2022-12-14_03:58:10.229548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:12.100862 run osmo-stp_10.42.42.5(pid=5993): stderr: | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035810423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035810423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035810424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:12.258071 run patchelf(pid=5996): Terminating (SIGINT) 03:58:12.439019 run patchelf(pid=5996): Terminated: ok {rc=0} 03:58:12.569433 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5993): Process ended prematurely: osmo-stp_10.42.42.5(pid=5993) [trial-2399↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5993)] [trial-2399↪gprs:trx-b200↪ping_idle_ping.py:27] 03:58:12.579126 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:58:12.607332 run osmo-hlr_10.42.42.2(pid=5990): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5990)] 03:58:12.658308 run osmo-hlr_10.42.42.2(pid=5990): stdout: | (launched: 2022-12-14_03:58:09.223682) 03:58:12.710476 run osmo-hlr_10.42.42.2(pid=5990): stderr: | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035809422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035809466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035809475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035809476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035809476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:12.762728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5989): Terminating (SIGTERM) 03:58:12.805354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5992): Terminating (SIGTERM) 03:58:12.848056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5995): Terminating (SIGTERM) 03:58:12.890929 --- ParallelTerminationStrategy: PID 5989 died... 03:58:12.911332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5989): Terminated: ok {rc=0} 03:58:12.957667 --- ParallelTerminationStrategy: PID 5992 died... 03:58:12.977509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5992): Terminated: ok {rc=0} 03:58:13.023602 --- ParallelTerminationStrategy: PID 5995 died... 03:58:13.043529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5995): Terminated: ok {rc=0} 03:58:13.131673 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 03:58:14.440804 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:58:14.446687 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:58:14.480113 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:58:14.519828 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:58:14.610998 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:58:14.644079 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:58:14.682033 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:58:15.279206 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:58:15.332400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.343668 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:15.394945 tst cs_paging_gprs_active.py: using LAC 38387 03:58:15.525061 tst cs_paging_gprs_active.py: using RAC 137 03:58:15.654703 tst cs_paging_gprs_active.py: using CellId 38387 03:58:15.784425 tst cs_paging_gprs_active.py: using BVCI 38388 03:58:15.910633 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.923268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.935393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.947509 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.960390 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.973281 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.986465 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:15.999378 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:16.012313 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:16.140203 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:16.262343 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:58:16.473634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:16.790183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6001): Launched 03:58:17.104936 run iperf3-srv_10.42.42.10(pid=6002): Launched 03:58:17.236861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:58:17.449937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:17.760321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6003): Launched 03:58:18.028354 run iperf3-srv_10.42.42.10(pid=6004): Launched 03:58:18.143103 tst cs_paging_gprs_active.py:38: start network... 03:58:18.347964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:18.824355 run create_hlr_db(pid=6005): Launched 03:58:18.954152 bus /gobi_6: Setting Powered False 03:58:20.018851 run create_hlr_db(pid=6005): Terminated: ok {rc=0} 03:58:20.456709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6007): Launched 03:58:20.763798 run osmo-hlr_10.42.42.2(pid=6008): Launched 03:58:20.880731 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:21.423977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6010): Launched 03:58:21.731153 run osmo-stp_10.42.42.5(pid=6011): Launched 03:58:21.849332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:22.380403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6013): Launched 03:58:22.497888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:22.758764 run patchelf(pid=6014): Launched 03:58:22.929555 run osmo-stp_10.42.42.5(pid=6011): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6011)] 03:58:23.059087 run osmo-stp_10.42.42.5(pid=6011): stdout: | (launched: 2022-12-14_03:58:21.674360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:23.190836 run osmo-stp_10.42.42.5(pid=6011): stderr: | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035821848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:23.322104 run osmo-stp_10.42.42.5(pid=6011): stdout: | (launched: 2022-12-14_03:58:21.674360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:23.447568 run osmo-stp_10.42.42.5(pid=6011): stderr: | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035821848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035821848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035821849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:23.595969 run patchelf(pid=6014): Terminating (SIGINT) 03:58:23.767225 run patchelf(pid=6014): Terminated: ok {rc=0} 03:58:23.890732 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6011): Process ended prematurely: osmo-stp_10.42.42.5(pid=6011) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6011)] [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:58:23.900211 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:58:23.927467 run osmo-hlr_10.42.42.2(pid=6008): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6008)] 03:58:23.976182 run osmo-hlr_10.42.42.2(pid=6008): stdout: | (launched: 2022-12-14_03:58:20.706918) 03:58:24.025954 run osmo-hlr_10.42.42.2(pid=6008): stderr: | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035820885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035820898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035820908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035820909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035820909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:24.075806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6001): Terminating (SIGTERM) 03:58:24.115448 run iperf3-srv_10.42.42.10(pid=6002): Terminating (SIGTERM) 03:58:24.155026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6003): Terminating (SIGTERM) 03:58:24.194627 run iperf3-srv_10.42.42.10(pid=6004): Terminating (SIGTERM) 03:58:24.233935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6007): Terminating (SIGTERM) 03:58:24.273391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6010): Terminating (SIGTERM) 03:58:24.313119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6013): Terminating (SIGTERM) 03:58:24.352781 --- ParallelTerminationStrategy: PID 6001 died... 03:58:24.371957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6001): Terminated: ok {rc=0} 03:58:24.415620 --- ParallelTerminationStrategy: PID 6002 died... 03:58:24.434112 run iperf3-srv_10.42.42.10(pid=6002): Terminated {rc=256} 03:58:24.477323 --- ParallelTerminationStrategy: PID 6003 died... 03:58:24.495846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6003): Terminated: ok {rc=0} 03:58:24.539296 --- ParallelTerminationStrategy: PID 6004 died... 03:58:24.557787 run iperf3-srv_10.42.42.10(pid=6004): Terminated {rc=256} 03:58:24.600935 --- ParallelTerminationStrategy: PID 6007 died... 03:58:24.619835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6007): Terminated: ok {rc=0} 03:58:24.663509 --- ParallelTerminationStrategy: PID 6010 died... 03:58:24.682091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6010): Terminated: ok {rc=0} 03:58:24.725398 --- ParallelTerminationStrategy: PID 6013 died... 03:58:24.743759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6013): Terminated: ok {rc=0} 03:58:24.828597 bus /gobi_0: Setting Powered False 03:58:25.928256 bus /gobi_0: Setting Powered False 03:58:27.041251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:58:28.190937 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.203202 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:28.258509 tst iperf3.py: using LAC 38388 03:58:28.389174 tst iperf3.py: using RAC 138 03:58:28.516877 tst iperf3.py: using CellId 38388 03:58:28.647340 tst iperf3.py: using BVCI 38389 03:58:28.768488 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.780293 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.791435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.802564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.814060 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.825650 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.837357 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.848672 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:28.860306 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:28.976308 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:29.198211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:29.527892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6015): Launched 03:58:29.815313 run iperf3-srv_10.42.42.10(pid=6016): Launched 03:58:29.940171 tst iperf3.py:8: start network... 03:58:30.160735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:30.671467 run create_hlr_db(pid=6017): Launched 03:58:30.797307 bus /gobi_6: Setting Powered False 03:58:31.872304 run create_hlr_db(pid=6017): Terminated: ok {rc=0} 03:58:32.343349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6019): Launched 03:58:32.653317 run osmo-hlr_10.42.42.2(pid=6020): Launched 03:58:32.772434 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:33.299775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6022): Launched 03:58:33.605609 run osmo-stp_10.42.42.5(pid=6023): Launched 03:58:33.722327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:34.251251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6025): Launched 03:58:34.369416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:34.627783 run patchelf(pid=6026): Launched 03:58:34.798152 run osmo-stp_10.42.42.5(pid=6023): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6023)] 03:58:34.927325 run osmo-stp_10.42.42.5(pid=6023): stdout: | (launched: 2022-12-14_03:58:33.548783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:35.057784 run osmo-stp_10.42.42.5(pid=6023): stderr: | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035833720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:35.188491 run osmo-stp_10.42.42.5(pid=6023): stdout: | (launched: 2022-12-14_03:58:33.548783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:35.314507 run osmo-stp_10.42.42.5(pid=6023): stderr: | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035833719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035833720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035833720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:35.462817 run patchelf(pid=6026): Terminating (SIGINT) 03:58:35.633224 run patchelf(pid=6026): Terminated: ok {rc=0} 03:58:35.756122 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6023): Process ended prematurely: osmo-stp_10.42.42.5(pid=6023) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6023)] [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 03:58:35.765749 tst iperf3.py:8: Test FAILED (7.6 sec) 03:58:35.793100 run osmo-hlr_10.42.42.2(pid=6020): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6020)] 03:58:35.840863 run osmo-hlr_10.42.42.2(pid=6020): stdout: | (launched: 2022-12-14_03:58:32.596361) 03:58:35.890074 run osmo-hlr_10.42.42.2(pid=6020): stderr: | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035832774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035832785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035832793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035832794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035832794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:35.940025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6015): Terminating (SIGTERM) 03:58:35.979543 run iperf3-srv_10.42.42.10(pid=6016): Terminating (SIGTERM) 03:58:36.018802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6019): Terminating (SIGTERM) 03:58:36.058220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6022): Terminating (SIGTERM) 03:58:36.097618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6025): Terminating (SIGTERM) 03:58:36.137290 --- ParallelTerminationStrategy: PID 6015 died... 03:58:36.156204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6015): Terminated: ok {rc=0} 03:58:36.199643 --- ParallelTerminationStrategy: PID 6016 died... 03:58:36.218018 run iperf3-srv_10.42.42.10(pid=6016): Terminated {rc=256} 03:58:36.261214 --- ParallelTerminationStrategy: PID 6019 died... 03:58:36.279705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6019): Terminated: ok {rc=0} 03:58:36.323088 --- ParallelTerminationStrategy: PID 6022 died... 03:58:36.341517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6022): Terminated: ok {rc=0} 03:58:36.384748 --- ParallelTerminationStrategy: PID 6025 died... 03:58:36.403202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6025): Terminated: ok {rc=0} 03:58:36.489692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:58:37.638821 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:37.650601 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:37.702006 tst iperf3m4.py: using LAC 38389 03:58:37.827052 tst iperf3m4.py: using RAC 139 03:58:37.948330 tst iperf3m4.py: using CellId 38389 03:58:38.068235 tst iperf3m4.py: using BVCI 38390 03:58:38.179700 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.190592 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.201358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.211974 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.222519 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.234004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.245544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.256732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:38.268103 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:38.390951 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:38.510985 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:38.631126 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:38.750693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:58:38.974785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:39.304810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6027): Launched 03:58:39.592226 run iperf3-srv_10.42.42.10(pid=6028): Launched 03:58:39.717954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:58:39.939658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:40.269974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6029): Launched 03:58:40.554812 run iperf3-srv_10.42.42.10(pid=6030): Launched 03:58:40.679565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:58:40.900862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:41.229932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6031): Launched 03:58:41.515493 run iperf3-srv_10.42.42.10(pid=6032): Launched 03:58:41.640526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:58:41.861826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:58:42.191664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Launched 03:58:42.478114 run iperf3-srv_10.42.42.10(pid=6034): Launched 03:58:42.602876 tst iperf3m4.py:8: start network... 03:58:42.823391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:43.332915 run create_hlr_db(pid=6035): Launched 03:58:43.458692 bus /gobi_6: Setting Powered False 03:58:44.522860 run create_hlr_db(pid=6035): Terminated: ok {rc=0} 03:58:44.959332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6037): Launched 03:58:45.265955 run osmo-hlr_10.42.42.2(pid=6038): Launched 03:58:45.386185 run osmo-stp_10.42.42.5: Starting osmo-stp 03:58:45.949736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6040): Launched 03:58:46.282309 run osmo-stp_10.42.42.5(pid=6041): Launched 03:58:46.593227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:58:47.204602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6043): Launched 03:58:47.351570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:58:47.634716 run patchelf(pid=6044): Launched 03:58:47.821285 run osmo-stp_10.42.42.5(pid=6041): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6041)] 03:58:47.960863 run osmo-stp_10.42.42.5(pid=6041): stdout: | (launched: 2022-12-14_03:58:46.223881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:48.101840 run osmo-stp_10.42.42.5(pid=6041): stderr: | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035846417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035846419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035846420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035846421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:48.243079 run osmo-stp_10.42.42.5(pid=6041): stdout: | (launched: 2022-12-14_03:58:46.223881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:58:48.377686 run osmo-stp_10.42.42.5(pid=6041): stderr: | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035846416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035846417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035846419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035846420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035846421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:58:48.538078 run patchelf(pid=6044): Terminating (SIGINT) 03:58:48.721176 run patchelf(pid=6044): Terminated: ok {rc=0} 03:58:48.854080 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6041): Process ended prematurely: osmo-stp_10.42.42.5(pid=6041) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6041)] [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 03:58:48.864605 tst iperf3m4.py:8: Test FAILED (11.3 sec) 03:58:48.893884 run osmo-hlr_10.42.42.2(pid=6038): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6038)] 03:58:48.945338 run osmo-hlr_10.42.42.2(pid=6038): stdout: | (launched: 2022-12-14_03:58:45.208659) 03:58:48.997538 run osmo-hlr_10.42.42.2(pid=6038): stderr: | [0;m[1;31m20221214035845383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035845383 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035845384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035845384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035845384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035845384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035845396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035845405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035845406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035845406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:58:49.050123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6027): Terminating (SIGTERM) 03:58:49.092359 run iperf3-srv_10.42.42.10(pid=6028): Terminating (SIGTERM) 03:58:49.134772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6029): Terminating (SIGTERM) 03:58:49.177048 run iperf3-srv_10.42.42.10(pid=6030): Terminating (SIGTERM) 03:58:49.219345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6031): Terminating (SIGTERM) 03:58:49.261604 run iperf3-srv_10.42.42.10(pid=6032): Terminating (SIGTERM) 03:58:49.303753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Terminating (SIGTERM) 03:58:49.345951 run iperf3-srv_10.42.42.10(pid=6034): Terminating (SIGTERM) 03:58:49.387993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6037): Terminating (SIGTERM) 03:58:49.430555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6040): Terminating (SIGTERM) 03:58:49.472657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6043): Terminating (SIGTERM) 03:58:49.515118 --- ParallelTerminationStrategy: PID 6027 died... 03:58:49.535362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6027): Terminated: ok {rc=0} 03:58:49.581716 --- ParallelTerminationStrategy: PID 6028 died... 03:58:49.601647 run iperf3-srv_10.42.42.10(pid=6028): Terminated {rc=256} 03:58:49.647740 --- ParallelTerminationStrategy: PID 6029 died... 03:58:49.667644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6029): Terminated: ok {rc=0} 03:58:49.713807 --- ParallelTerminationStrategy: PID 6030 died... 03:58:49.733701 run iperf3-srv_10.42.42.10(pid=6030): Terminated {rc=256} 03:58:49.780034 --- ParallelTerminationStrategy: PID 6031 died... 03:58:49.800007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6031): Terminated: ok {rc=0} 03:58:49.846724 --- ParallelTerminationStrategy: PID 6032 died... 03:58:49.866555 run iperf3-srv_10.42.42.10(pid=6032): Terminated {rc=256} 03:58:49.912327 --- ParallelTerminationStrategy: PID 6033 died... 03:58:49.932171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6033): Terminated: ok {rc=0} 03:58:49.978269 --- ParallelTerminationStrategy: PID 6034 died... 03:58:49.998300 run iperf3-srv_10.42.42.10(pid=6034): Terminated {rc=256} 03:58:50.044356 --- ParallelTerminationStrategy: PID 6037 died... 03:58:50.064189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6037): Terminated: ok {rc=0} 03:58:50.110455 --- ParallelTerminationStrategy: PID 6040 died... 03:58:50.130335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6040): Terminated: ok {rc=0} 03:58:50.176506 --- ParallelTerminationStrategy: PID 6043 died... 03:58:50.196624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6043): Terminated: ok {rc=0} 03:58:50.284705 bus /gobi_4: Setting Powered False 03:58:51.383632 bus /gobi_4: Setting Powered False 03:58:52.500393 bus /gobi_1: Setting Powered False 03:58:53.598752 bus /gobi_1: Setting Powered False 03:58:54.716771 bus /gobi_0: Setting Powered False 03:58:55.814578 bus /gobi_0: Setting Powered False 03:58:56.931654 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 03:58:58.033699 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.045283 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:58:58.095684 tst ping.py: using LAC 38390 03:58:58.215232 tst ping.py: using RAC 140 03:58:58.332780 tst ping.py: using CellId 38390 03:58:58.461166 tst ping.py: using BVCI 38391 03:58:58.579329 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.591017 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.602442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.613908 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.625539 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.636855 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.648680 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:58:58.660151 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:58:58.776305 tst ping.py:19: start network... 03:58:58.976618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:58:59.471268 run create_hlr_db(pid=6045): Launched 03:58:59.594010 bus /gobi_6: Setting Powered False 03:59:00.657832 run create_hlr_db(pid=6045): Terminated: ok {rc=0} 03:59:01.129053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6048): Launched 03:59:01.529201 run osmo-hlr_10.42.42.2(pid=6049): Launched 03:59:01.716324 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:02.413088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6051): Launched 03:59:02.736267 run osmo-stp_10.42.42.5(pid=6052): Launched 03:59:02.861632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:03.418108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6054): Launched 03:59:03.542748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:03.816369 run patchelf(pid=6055): Launched 03:59:03.997921 run osmo-stp_10.42.42.5(pid=6052): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6052)] 03:59:04.134655 run osmo-stp_10.42.42.5(pid=6052): stdout: | (launched: 2022-12-14_03:59:02.676709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:04.272912 run osmo-stp_10.42.42.5(pid=6052): stderr: | [0;m[38;5;43m20221214035902869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035902869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035902870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035902870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035902870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035902871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035902871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:04.411929 run osmo-stp_10.42.42.5(pid=6052): stdout: | (launched: 2022-12-14_03:59:02.676709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:04.544367 run osmo-stp_10.42.42.5(pid=6052): stderr: | [0;m[38;5;43m20221214035902869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035902869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035902870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035902870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035902870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035902871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035902871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:04.700716 run patchelf(pid=6055): Terminating (SIGINT) 03:59:04.881194 run patchelf(pid=6055): Terminated: ok {rc=0} 03:59:05.010878 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6052): Process ended prematurely: osmo-stp_10.42.42.5(pid=6052) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6052)] [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 03:59:05.020605 tst ping.py:22: Test FAILED (7.0 sec) 03:59:05.048850 run osmo-hlr_10.42.42.2(pid=6049): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6049)] 03:59:05.100031 run osmo-hlr_10.42.42.2(pid=6049): stdout: | (launched: 2022-12-14_03:59:01.467374) 03:59:05.152306 run osmo-hlr_10.42.42.2(pid=6049): stderr: | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035901763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035901778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035901796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035901796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035901796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:05.205504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6048): Terminating (SIGTERM) 03:59:05.247357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6051): Terminating (SIGTERM) 03:59:05.289371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6054): Terminating (SIGTERM) 03:59:05.331978 --- ParallelTerminationStrategy: PID 6048 died... 03:59:05.352703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6048): Terminated: ok {rc=0} 03:59:05.399650 --- ParallelTerminationStrategy: PID 6051 died... 03:59:05.419798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6051): Terminated: ok {rc=0} 03:59:05.466230 --- ParallelTerminationStrategy: PID 6054 died... 03:59:05.486323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6054): Terminated: ok {rc=0} 03:59:05.577359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:59:06.664508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:06.676738 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:59:06.736260 tst ping_idle_ping.py: using LAC 38391 03:59:06.862537 tst ping_idle_ping.py: using RAC 141 03:59:06.987762 tst ping_idle_ping.py: using CellId 38391 03:59:07.112833 tst ping_idle_ping.py: using BVCI 38392 03:59:07.230420 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.241933 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.253167 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.264296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.276150 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.288047 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.300121 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:59:07.312186 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:59:07.429555 tst ping_idle_ping.py:24: start network... 03:59:07.632370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:08.101330 run create_hlr_db(pid=6056): Launched 03:59:08.225314 bus /gobi_6: Setting Powered False 03:59:09.285309 run create_hlr_db(pid=6056): Terminated: ok {rc=0} 03:59:09.728328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Launched 03:59:10.054505 run osmo-hlr_10.42.42.2(pid=6059): Launched 03:59:10.179546 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:10.737881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Launched 03:59:11.062426 run osmo-stp_10.42.42.5(pid=6062): Launched 03:59:11.187074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:11.746841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6064): Launched 03:59:11.873512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:12.148253 run patchelf(pid=6065): Launched 03:59:12.330450 run osmo-stp_10.42.42.5(pid=6062): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] 03:59:12.467580 run osmo-stp_10.42.42.5(pid=6062): stdout: | (launched: 2022-12-14_03:59:11.002446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:12.606659 run osmo-stp_10.42.42.5(pid=6062): stderr: | [0;m[38;5;43m20221214035911196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035911196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035911197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035911197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:12.745704 run osmo-stp_10.42.42.5(pid=6062): stdout: | (launched: 2022-12-14_03:59:11.002446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:12.878929 run osmo-stp_10.42.42.5(pid=6062): stderr: | [0;m[38;5;43m20221214035911196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035911196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035911197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035911197 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035911198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:13.036035 run patchelf(pid=6065): Terminating (SIGINT) 03:59:13.217129 run patchelf(pid=6065): Terminated: ok {rc=0} 03:59:13.347873 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6062): Process ended prematurely: osmo-stp_10.42.42.5(pid=6062) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 03:59:13.357671 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:59:13.385982 run osmo-hlr_10.42.42.2(pid=6059): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6059)] 03:59:13.437233 run osmo-hlr_10.42.42.2(pid=6059): stdout: | (launched: 2022-12-14_03:59:09.995009) 03:59:13.489715 run osmo-hlr_10.42.42.2(pid=6059): stderr: | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035910193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035910206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035910216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035910216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035910217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:13.542663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminating (SIGTERM) 03:59:13.585292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Terminating (SIGTERM) 03:59:13.628364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6064): Terminating (SIGTERM) 03:59:13.671528 --- ParallelTerminationStrategy: PID 6058 died... 03:59:13.692064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6058): Terminated: ok {rc=0} 03:59:13.739020 --- ParallelTerminationStrategy: PID 6061 died... 03:59:13.759041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6061): Terminated: ok {rc=0} 03:59:13.806151 --- ParallelTerminationStrategy: PID 6064 died... 03:59:13.826134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6064): Terminated: ok {rc=0} 03:59:13.914830 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:59:15.222193 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:59:15.228619 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:59:15.261890 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:59:15.301110 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:59:15.388415 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:59:15.421382 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:59:15.459691 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:59:16.084746 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:59:16.161988 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.179855 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:16.274659 tst cs_paging_gprs_active.py: using LAC 38392 03:59:16.436475 tst cs_paging_gprs_active.py: using RAC 142 03:59:16.567949 tst cs_paging_gprs_active.py: using CellId 38392 03:59:16.690260 tst cs_paging_gprs_active.py: using BVCI 38393 03:59:16.841125 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.852072 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.863352 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.875188 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.886929 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.898892 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.911689 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.923449 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:16.935524 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:17.065266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:17.184439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:59:17.396060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:17.726271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Launched 03:59:18.013122 run iperf3-srv_10.42.42.10(pid=6070): Launched 03:59:18.137987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:59:18.359144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:18.688865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6071): Launched 03:59:18.977913 run iperf3-srv_10.42.42.10(pid=6072): Launched 03:59:19.100718 tst cs_paging_gprs_active.py:38: start network... 03:59:19.321271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:19.830564 run create_hlr_db(pid=6073): Launched 03:59:19.955385 bus /gobi_6: Setting Powered False 03:59:21.020348 run create_hlr_db(pid=6073): Terminated: ok {rc=0} 03:59:21.475688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6075): Launched 03:59:21.806095 run osmo-hlr_10.42.42.2(pid=6076): Launched 03:59:21.933475 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:22.500359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6078): Launched 03:59:22.831582 run osmo-stp_10.42.42.5(pid=6079): Launched 03:59:22.957329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:23.525913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6081): Launched 03:59:23.652125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:23.932095 run patchelf(pid=6082): Launched 03:59:24.116363 run osmo-stp_10.42.42.5(pid=6079): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6079)] 03:59:24.256046 run osmo-stp_10.42.42.5(pid=6079): stdout: | (launched: 2022-12-14_03:59:22.770887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:24.396920 run osmo-stp_10.42.42.5(pid=6079): stderr: | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035922963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:24.538080 run osmo-stp_10.42.42.5(pid=6079): stdout: | (launched: 2022-12-14_03:59:22.770887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:24.673411 run osmo-stp_10.42.42.5(pid=6079): stderr: | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035922963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035922963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035922964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:24.834074 run patchelf(pid=6082): Terminating (SIGINT) 03:59:25.018162 run patchelf(pid=6082): Terminated: ok {rc=0} 03:59:25.150731 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6079): Process ended prematurely: osmo-stp_10.42.42.5(pid=6079) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6079)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:59:25.161031 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 03:59:25.189821 run osmo-hlr_10.42.42.2(pid=6076): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6076)] 03:59:25.241518 run osmo-hlr_10.42.42.2(pid=6076): stdout: | (launched: 2022-12-14_03:59:21.745659) 03:59:25.294378 run osmo-hlr_10.42.42.2(pid=6076): stderr: | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035921945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035921957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035921965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035921965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035921965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:25.347416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Terminating (SIGTERM) 03:59:25.390327 run iperf3-srv_10.42.42.10(pid=6070): Terminating (SIGTERM) 03:59:25.433660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6071): Terminating (SIGTERM) 03:59:25.476867 run iperf3-srv_10.42.42.10(pid=6072): Terminating (SIGTERM) 03:59:25.520145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6075): Terminating (SIGTERM) 03:59:25.563193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6078): Terminating (SIGTERM) 03:59:25.605467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6081): Terminating (SIGTERM) 03:59:25.648411 --- ParallelTerminationStrategy: PID 6069 died... 03:59:25.669042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6069): Terminated: ok {rc=0} 03:59:25.716039 --- ParallelTerminationStrategy: PID 6070 died... 03:59:25.735968 run iperf3-srv_10.42.42.10(pid=6070): Terminated {rc=256} 03:59:25.782505 --- ParallelTerminationStrategy: PID 6071 died... 03:59:25.802802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6071): Terminated: ok {rc=0} 03:59:25.849522 --- ParallelTerminationStrategy: PID 6072 died... 03:59:25.869477 run iperf3-srv_10.42.42.10(pid=6072): Terminated {rc=256} 03:59:25.915687 --- ParallelTerminationStrategy: PID 6075 died... 03:59:25.935789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6075): Terminated: ok {rc=0} 03:59:25.982133 --- ParallelTerminationStrategy: PID 6078 died... 03:59:26.002200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6078): Terminated: ok {rc=0} 03:59:26.048595 --- ParallelTerminationStrategy: PID 6081 died... 03:59:26.068732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6081): Terminated: ok {rc=0} 03:59:26.158310 bus /gobi_0: Setting Powered False 03:59:27.257854 bus /gobi_0: Setting Powered False 03:59:28.376324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:59:29.524159 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:29.535701 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:29.608421 tst iperf3.py: using LAC 38393 03:59:29.730516 tst iperf3.py: using RAC 143 03:59:29.852160 tst iperf3.py: using CellId 38393 03:59:29.973592 tst iperf3.py: using BVCI 38394 03:59:30.086370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.097339 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.107967 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.118617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.129184 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.140234 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.151412 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.162356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:30.173078 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:30.289398 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:30.493883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:30.801031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6083): Launched 03:59:31.106176 run iperf3-srv_10.42.42.10(pid=6084): Launched 03:59:31.247790 tst iperf3.py:8: start network... 03:59:31.477164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:32.003919 run create_hlr_db(pid=6085): Launched 03:59:32.154124 bus /gobi_6: Setting Powered False 03:59:33.218379 run create_hlr_db(pid=6085): Terminated: ok {rc=0} 03:59:33.675339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Launched 03:59:34.006326 run osmo-hlr_10.42.42.2(pid=6088): Launched 03:59:34.132850 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:34.698410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Launched 03:59:35.027311 run osmo-stp_10.42.42.5(pid=6091): Launched 03:59:35.154445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:35.721082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Launched 03:59:35.848751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:36.126256 run patchelf(pid=6095): Launched 03:59:36.308172 run osmo-stp_10.42.42.5(pid=6091): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] 03:59:36.447588 run osmo-stp_10.42.42.5(pid=6091): stdout: | (launched: 2022-12-14_03:59:34.967051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:36.588107 run osmo-stp_10.42.42.5(pid=6091): stderr: | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035935160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:36.728577 run osmo-stp_10.42.42.5(pid=6091): stdout: | (launched: 2022-12-14_03:59:34.967051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:36.863750 run osmo-stp_10.42.42.5(pid=6091): stderr: | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035935160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035935160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035935161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:37.024113 run patchelf(pid=6095): Terminating (SIGINT) 03:59:37.207387 run patchelf(pid=6095): Terminated: ok {rc=0} 03:59:37.339653 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6091): Process ended prematurely: osmo-stp_10.42.42.5(pid=6091) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 03:59:37.350043 tst iperf3.py:8: Test FAILED (7.9 sec) 03:59:37.379199 run osmo-hlr_10.42.42.2(pid=6088): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6088)] 03:59:37.430937 run osmo-hlr_10.42.42.2(pid=6088): stdout: | (launched: 2022-12-14_03:59:33.945805) 03:59:37.484488 run osmo-hlr_10.42.42.2(pid=6088): stderr: | [0;m[1;31m20221214035934144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035934144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035934145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035934145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035934145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035934145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035934157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035934167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035934167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035934167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:37.537901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6083): Terminating (SIGTERM) 03:59:37.580396 run iperf3-srv_10.42.42.10(pid=6084): Terminating (SIGTERM) 03:59:37.623030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Terminating (SIGTERM) 03:59:37.666088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Terminating (SIGTERM) 03:59:37.708762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Terminating (SIGTERM) 03:59:37.752112 --- ParallelTerminationStrategy: PID 6083 died... 03:59:37.772840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6083): Terminated: ok {rc=0} 03:59:37.820302 --- ParallelTerminationStrategy: PID 6084 died... 03:59:37.840327 run iperf3-srv_10.42.42.10(pid=6084): Terminated {rc=256} 03:59:37.887323 --- ParallelTerminationStrategy: PID 6087 died... 03:59:37.907493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6087): Terminated: ok {rc=0} 03:59:37.954448 --- ParallelTerminationStrategy: PID 6090 died... 03:59:37.974568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6090): Terminated: ok {rc=0} 03:59:38.021367 --- ParallelTerminationStrategy: PID 6093 died... 03:59:38.041611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6093): Terminated: ok {rc=0} 03:59:38.130694 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:59:39.279201 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.290988 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:39.360115 tst iperf3m4.py: using LAC 38394 03:59:39.480289 tst iperf3m4.py: using RAC 144 03:59:39.601641 tst iperf3m4.py: using CellId 38394 03:59:39.721417 tst iperf3m4.py: using BVCI 38395 03:59:39.832851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.843729 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.854412 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.865122 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.875582 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.886599 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.897786 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.908568 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:39.919622 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:40.040730 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:40.160381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:40.281888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:59:40.399760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:59:40.605364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:40.913732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Launched 03:59:41.183128 run iperf3-srv_10.42.42.10(pid=6097): Launched 03:59:41.298879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:59:41.503147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:41.811359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Launched 03:59:42.080797 run iperf3-srv_10.42.42.10(pid=6099): Launched 03:59:42.196452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:59:42.401202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:42.708866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Launched 03:59:42.976350 run iperf3-srv_10.42.42.10(pid=6101): Launched 03:59:43.091872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:59:43.296095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:59:43.603577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6102): Launched 03:59:43.871649 run iperf3-srv_10.42.42.10(pid=6103): Launched 03:59:43.988246 tst iperf3m4.py:8: start network... 03:59:44.192718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:59:44.669312 run create_hlr_db(pid=6104): Launched 03:59:44.794996 bus /gobi_6: Setting Powered False 03:59:45.858862 run create_hlr_db(pid=6104): Terminated: ok {rc=0} 03:59:46.306780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6106): Launched 03:59:46.637694 run osmo-hlr_10.42.42.2(pid=6107): Launched 03:59:46.919915 run osmo-stp_10.42.42.5: Starting osmo-stp 03:59:47.552861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6109): Launched 03:59:47.884607 run osmo-stp_10.42.42.5(pid=6110): Launched 03:59:48.012299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:59:48.579929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6112): Launched 03:59:48.707239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:59:48.986136 run patchelf(pid=6113): Launched 03:59:49.171100 run osmo-stp_10.42.42.5(pid=6110): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6110)] 03:59:49.310328 run osmo-stp_10.42.42.5(pid=6110): stdout: | (launched: 2022-12-14_03:59:47.823629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:49.451041 run osmo-stp_10.42.42.5(pid=6110): stderr: | [0;m[38;5;43m20221214035948015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035948016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035948016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035948016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:49.591794 run osmo-stp_10.42.42.5(pid=6110): stdout: | (launched: 2022-12-14_03:59:47.823629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:59:49.726666 run osmo-stp_10.42.42.5(pid=6110): stderr: | [0;m[38;5;43m20221214035948015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214035948016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214035948016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214035948016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214035948017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:59:49.887497 run patchelf(pid=6113): Terminating (SIGINT) 03:59:50.071568 run patchelf(pid=6113): Terminated: ok {rc=0} 03:59:50.204454 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6110): Process ended prematurely: osmo-stp_10.42.42.5(pid=6110) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6110)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:59:50.215479 tst iperf3m4.py:8: Test FAILED (11.0 sec) 03:59:50.244676 run osmo-hlr_10.42.42.2(pid=6107): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6107)] 03:59:50.296177 run osmo-hlr_10.42.42.2(pid=6107): stdout: | (launched: 2022-12-14_03:59:46.573730) 03:59:50.348750 run osmo-hlr_10.42.42.2(pid=6107): stderr: | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214035946793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214035946806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214035946819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214035946819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214035946819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:59:50.401562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminating (SIGTERM) 03:59:50.444197 run iperf3-srv_10.42.42.10(pid=6097): Terminating (SIGTERM) 03:59:50.486706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Terminating (SIGTERM) 03:59:50.529739 run iperf3-srv_10.42.42.10(pid=6099): Terminating (SIGTERM) 03:59:50.572204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Terminating (SIGTERM) 03:59:50.615105 run iperf3-srv_10.42.42.10(pid=6101): Terminating (SIGTERM) 03:59:50.657871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6102): Terminating (SIGTERM) 03:59:50.700572 run iperf3-srv_10.42.42.10(pid=6103): Terminating (SIGTERM) 03:59:50.743468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6106): Terminating (SIGTERM) 03:59:50.786341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6109): Terminating (SIGTERM) 03:59:50.829536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6112): Terminating (SIGTERM) 03:59:50.872512 --- ParallelTerminationStrategy: PID 6096 died... 03:59:50.893405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6096): Terminated: ok {rc=0} 03:59:50.940699 --- ParallelTerminationStrategy: PID 6097 died... 03:59:50.960861 run iperf3-srv_10.42.42.10(pid=6097): Terminated {rc=256} 03:59:51.007792 --- ParallelTerminationStrategy: PID 6098 died... 03:59:51.028167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6098): Terminated: ok {rc=0} 03:59:51.075057 --- ParallelTerminationStrategy: PID 6099 died... 03:59:51.095290 run iperf3-srv_10.42.42.10(pid=6099): Terminated {rc=256} 03:59:51.142129 --- ParallelTerminationStrategy: PID 6100 died... 03:59:51.162540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6100): Terminated: ok {rc=0} 03:59:51.209328 --- ParallelTerminationStrategy: PID 6101 died... 03:59:51.229563 run iperf3-srv_10.42.42.10(pid=6101): Terminated {rc=256} 03:59:51.276374 --- ParallelTerminationStrategy: PID 6102 died... 03:59:51.296862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6102): Terminated: ok {rc=0} 03:59:51.343700 --- ParallelTerminationStrategy: PID 6103 died... 03:59:51.364056 run iperf3-srv_10.42.42.10(pid=6103): Terminated {rc=256} 03:59:51.411130 --- ParallelTerminationStrategy: PID 6106 died... 03:59:51.431460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6106): Terminated: ok {rc=0} 03:59:51.478328 --- ParallelTerminationStrategy: PID 6109 died... 03:59:51.498644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6109): Terminated: ok {rc=0} 03:59:51.545561 --- ParallelTerminationStrategy: PID 6112 died... 03:59:51.565966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6112): Terminated: ok {rc=0} 03:59:51.655201 bus /gobi_4: Setting Powered False 03:59:52.755156 bus /gobi_4: Setting Powered False 03:59:53.875309 bus /gobi_1: Setting Powered False 03:59:54.975541 bus /gobi_1: Setting Powered False 03:59:56.091429 bus /gobi_0: Setting Powered False 03:59:57.191731 bus /gobi_0: Setting Powered False 03:59:58.306015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:59:59.407502 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:59.419373 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:59:59.490085 tst ping.py: using LAC 38395 03:59:59.608671 tst ping.py: using RAC 145 03:59:59.728724 tst ping.py: using CellId 38395 03:59:59.849336 tst ping.py: using BVCI 38396 03:59:59.959114 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:59.970577 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:59.981699 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:59:59.992681 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:00.003604 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:00.014403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:00.025424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:00.036189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:00:00.150314 tst ping.py:19: start network... 04:00:00.351161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:00.819151 run create_hlr_db(pid=6114): Launched 04:00:00.978480 bus /gobi_6: Setting Powered False 04:00:02.038918 run create_hlr_db(pid=6114): Terminated: ok {rc=0} 04:00:02.465971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Launched 04:00:02.771004 run osmo-hlr_10.42.42.2(pid=6120): Launched 04:00:02.886982 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:03.407602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Launched 04:00:03.710817 run osmo-stp_10.42.42.5(pid=6123): Launched 04:00:03.827174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:04.349421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Launched 04:00:04.465161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:04.720264 run patchelf(pid=6126): Launched 04:00:04.887394 run osmo-stp_10.42.42.5(pid=6123): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] 04:00:05.014877 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-14_04:00:03.654324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:05.144234 run osmo-stp_10.42.42.5(pid=6123): stderr: | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040003826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:05.273755 run osmo-stp_10.42.42.5(pid=6123): stdout: | (launched: 2022-12-14_04:00:03.654324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:05.396892 run osmo-stp_10.42.42.5(pid=6123): stderr: | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040003825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040003826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:05.543040 run patchelf(pid=6126): Terminating (SIGINT) 04:00:05.711471 run patchelf(pid=6126): Terminated: ok {rc=0} 04:00:05.832619 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 04:00:05.841778 tst ping.py:22: Test FAILED (6.4 sec) 04:00:05.868746 run osmo-hlr_10.42.42.2(pid=6120): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6120)] 04:00:05.916839 run osmo-hlr_10.42.42.2(pid=6120): stdout: | (launched: 2022-12-14_04:00:02.714768) 04:00:05.966781 run osmo-hlr_10.42.42.2(pid=6120): stderr: | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040002892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040002904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040002913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040002913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040002913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:06.017483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminating (SIGTERM) 04:00:06.057144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminating (SIGTERM) 04:00:06.096912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Terminating (SIGTERM) 04:00:06.136890 --- ParallelTerminationStrategy: PID 6119 died... 04:00:06.156146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6119): Terminated: ok {rc=0} 04:00:06.200241 --- ParallelTerminationStrategy: PID 6122 died... 04:00:06.219048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6122): Terminated: ok {rc=0} 04:00:06.263038 --- ParallelTerminationStrategy: PID 6125 died... 04:00:06.281800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6125): Terminated: ok {rc=0} 04:00:06.367974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:00:07.458588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:07.470728 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:00:07.541456 tst ping_idle_ping.py: using LAC 38396 04:00:07.669701 tst ping_idle_ping.py: using RAC 146 04:00:07.799346 tst ping_idle_ping.py: using CellId 38396 04:00:07.927911 tst ping_idle_ping.py: using BVCI 38397 04:00:08.046943 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.058734 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.070199 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.081526 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.093293 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.104829 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.116701 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:00:08.128335 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:00:08.245973 tst ping_idle_ping.py:24: start network... 04:00:08.447603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:08.922937 run create_hlr_db(pid=6127): Launched 04:00:09.048341 bus /gobi_6: Setting Powered False 04:00:10.108709 run create_hlr_db(pid=6127): Terminated: ok {rc=0} 04:00:10.530551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Launched 04:00:10.831611 run osmo-hlr_10.42.42.2(pid=6130): Launched 04:00:10.945984 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:11.483609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Launched 04:00:11.783818 run osmo-stp_10.42.42.5(pid=6133): Launched 04:00:11.898579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:12.420588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Launched 04:00:12.536366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:12.790771 run patchelf(pid=6136): Launched 04:00:12.960163 run osmo-stp_10.42.42.5(pid=6133): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] 04:00:13.087977 run osmo-stp_10.42.42.5(pid=6133): stdout: | (launched: 2022-12-14_04:00:11.728012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:13.218140 run osmo-stp_10.42.42.5(pid=6133): stderr: | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040011899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:13.347861 run osmo-stp_10.42.42.5(pid=6133): stdout: | (launched: 2022-12-14_04:00:11.728012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:13.471348 run osmo-stp_10.42.42.5(pid=6133): stderr: | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040011898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040011899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040011899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:13.617608 run patchelf(pid=6136): Terminating (SIGINT) 04:00:13.785830 run patchelf(pid=6136): Terminated: ok {rc=0} 04:00:13.907352 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6133): Process ended prematurely: osmo-stp_10.42.42.5(pid=6133) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:00:13.916336 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:00:13.942943 run osmo-hlr_10.42.42.2(pid=6130): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6130)] 04:00:13.991218 run osmo-hlr_10.42.42.2(pid=6130): stdout: | (launched: 2022-12-14_04:00:10.775426) 04:00:14.041431 run osmo-hlr_10.42.42.2(pid=6130): stderr: | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040010949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040010959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040010967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040010967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040010968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:14.091920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Terminating (SIGTERM) 04:00:14.131649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Terminating (SIGTERM) 04:00:14.171412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Terminating (SIGTERM) 04:00:14.211302 --- ParallelTerminationStrategy: PID 6129 died... 04:00:14.230428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6129): Terminated: ok {rc=0} 04:00:14.273940 --- ParallelTerminationStrategy: PID 6132 died... 04:00:14.292537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6132): Terminated: ok {rc=0} 04:00:14.336203 --- ParallelTerminationStrategy: PID 6135 died... 04:00:14.354736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6135): Terminated: ok {rc=0} 04:00:14.437413 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:00:15.739709 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:00:15.745997 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:00:15.778722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:00:15.817460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:00:15.909404 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:00:15.959832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:00:15.999704 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:00:16.581510 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:00:16.638872 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:16.650475 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:16.720779 tst cs_paging_gprs_active.py: using LAC 38397 04:00:16.856628 tst cs_paging_gprs_active.py: using RAC 147 04:00:17.023110 tst cs_paging_gprs_active.py: using CellId 38397 04:00:17.157713 tst cs_paging_gprs_active.py: using BVCI 38398 04:00:17.288123 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.300395 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.312594 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.324840 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.338331 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.351633 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.364911 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.379322 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:17.393175 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:17.511850 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:17.633364 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:00:17.856763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:18.187014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6140): Launched 04:00:18.475294 run iperf3-srv_10.42.42.10(pid=6141): Launched 04:00:18.600078 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:00:18.821752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:19.152679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6142): Launched 04:00:19.440758 run iperf3-srv_10.42.42.10(pid=6143): Launched 04:00:19.563886 tst cs_paging_gprs_active.py:38: start network... 04:00:19.785637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:20.296525 run create_hlr_db(pid=6144): Launched 04:00:20.426632 bus /gobi_6: Setting Powered False 04:00:21.490706 run create_hlr_db(pid=6144): Terminated: ok {rc=0} 04:00:21.929314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6146): Launched 04:00:22.238583 run osmo-hlr_10.42.42.2(pid=6147): Launched 04:00:22.357981 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:22.904523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6149): Launched 04:00:23.211632 run osmo-stp_10.42.42.5(pid=6150): Launched 04:00:23.328561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:23.857640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Launched 04:00:23.974710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:24.235485 run patchelf(pid=6154): Launched 04:00:24.406516 run osmo-stp_10.42.42.5(pid=6150): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6150)] 04:00:24.536414 run osmo-stp_10.42.42.5(pid=6150): stdout: | (launched: 2022-12-14_04:00:23.154726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:24.667896 run osmo-stp_10.42.42.5(pid=6150): stderr: | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040023326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:24.799206 run osmo-stp_10.42.42.5(pid=6150): stdout: | (launched: 2022-12-14_04:00:23.154726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:24.924818 run osmo-stp_10.42.42.5(pid=6150): stderr: | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040023325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040023326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040023326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:25.073952 run patchelf(pid=6154): Terminating (SIGINT) 04:00:25.245745 run patchelf(pid=6154): Terminated: ok {rc=0} 04:00:25.369454 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6150): Process ended prematurely: osmo-stp_10.42.42.5(pid=6150) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6150)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:00:25.379011 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:00:25.406342 run osmo-hlr_10.42.42.2(pid=6147): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6147)] 04:00:25.453705 run osmo-hlr_10.42.42.2(pid=6147): stdout: | (launched: 2022-12-14_04:00:22.181845) 04:00:25.502945 run osmo-hlr_10.42.42.2(pid=6147): stderr: | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040022357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040022370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040022379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040022379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040022379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:25.552369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6140): Terminating (SIGTERM) 04:00:25.591998 run iperf3-srv_10.42.42.10(pid=6141): Terminating (SIGTERM) 04:00:25.631259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6142): Terminating (SIGTERM) 04:00:25.670684 run iperf3-srv_10.42.42.10(pid=6143): Terminating (SIGTERM) 04:00:25.709958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6146): Terminating (SIGTERM) 04:00:25.749365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6149): Terminating (SIGTERM) 04:00:25.788672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Terminating (SIGTERM) 04:00:25.828267 --- ParallelTerminationStrategy: PID 6140 died... 04:00:25.847324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6140): Terminated: ok {rc=0} 04:00:25.891009 --- ParallelTerminationStrategy: PID 6141 died... 04:00:25.909456 run iperf3-srv_10.42.42.10(pid=6141): Terminated {rc=256} 04:00:25.952626 --- ParallelTerminationStrategy: PID 6142 died... 04:00:25.971232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6142): Terminated: ok {rc=0} 04:00:26.014713 --- ParallelTerminationStrategy: PID 6143 died... 04:00:26.033119 run iperf3-srv_10.42.42.10(pid=6143): Terminated {rc=256} 04:00:26.076253 --- ParallelTerminationStrategy: PID 6146 died... 04:00:26.094736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6146): Terminated: ok {rc=0} 04:00:26.137885 --- ParallelTerminationStrategy: PID 6149 died... 04:00:26.156551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6149): Terminated: ok {rc=0} 04:00:26.200325 --- ParallelTerminationStrategy: PID 6153 died... 04:00:26.218853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6153): Terminated: ok {rc=0} 04:00:26.303855 bus /gobi_0: Setting Powered False 04:00:27.404327 bus /gobi_0: Setting Powered False 04:00:28.518673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:00:29.665326 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:29.677125 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:29.751045 tst iperf3.py: using LAC 38398 04:00:29.872193 tst iperf3.py: using RAC 148 04:00:29.993612 tst iperf3.py: using CellId 38398 04:00:30.113545 tst iperf3.py: using BVCI 38399 04:00:30.225500 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.236429 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.247131 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.257893 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.268461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.279290 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.290891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.301836 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:30.313019 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:30.428414 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:30.634734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:30.951871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Launched 04:00:31.249652 run iperf3-srv_10.42.42.10(pid=6156): Launched 04:00:31.373155 tst iperf3.py:8: start network... 04:00:31.581682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:32.067080 run create_hlr_db(pid=6157): Launched 04:00:32.214701 bus /gobi_6: Setting Powered False 04:00:33.275245 run create_hlr_db(pid=6157): Terminated: ok {rc=0} 04:00:33.701473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Launched 04:00:34.009413 run osmo-hlr_10.42.42.2(pid=6160): Launched 04:00:34.126489 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:34.672177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Launched 04:00:34.979112 run osmo-stp_10.42.42.5(pid=6163): Launched 04:00:35.095801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:35.624464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Launched 04:00:35.743703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:36.003065 run patchelf(pid=6166): Launched 04:00:36.174077 run osmo-stp_10.42.42.5(pid=6163): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] 04:00:36.304470 run osmo-stp_10.42.42.5(pid=6163): stdout: | (launched: 2022-12-14_04:00:34.922238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:36.435716 run osmo-stp_10.42.42.5(pid=6163): stderr: | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040035093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:36.566947 run osmo-stp_10.42.42.5(pid=6163): stdout: | (launched: 2022-12-14_04:00:34.922238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:36.692535 run osmo-stp_10.42.42.5(pid=6163): stderr: | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040035093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040035093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040035094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:36.841345 run patchelf(pid=6166): Terminating (SIGINT) 04:00:37.011900 run patchelf(pid=6166): Terminated: ok {rc=0} 04:00:37.135004 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6163): Process ended prematurely: osmo-stp_10.42.42.5(pid=6163) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 04:00:37.144533 tst iperf3.py:8: Test FAILED (7.5 sec) 04:00:37.171660 run osmo-hlr_10.42.42.2(pid=6160): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6160)] 04:00:37.219404 run osmo-hlr_10.42.42.2(pid=6160): stdout: | (launched: 2022-12-14_04:00:33.952264) 04:00:37.268920 run osmo-hlr_10.42.42.2(pid=6160): stderr: | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040034128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040034140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040034150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040034151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040034151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:37.319034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Terminating (SIGTERM) 04:00:37.358847 run iperf3-srv_10.42.42.10(pid=6156): Terminating (SIGTERM) 04:00:37.398762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Terminating (SIGTERM) 04:00:37.438868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Terminating (SIGTERM) 04:00:37.478917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Terminating (SIGTERM) 04:00:37.519197 --- ParallelTerminationStrategy: PID 6155 died... 04:00:37.538499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6155): Terminated: ok {rc=0} 04:00:37.582857 --- ParallelTerminationStrategy: PID 6156 died... 04:00:37.601757 run iperf3-srv_10.42.42.10(pid=6156): Terminated {rc=256} 04:00:37.645887 --- ParallelTerminationStrategy: PID 6159 died... 04:00:37.664836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6159): Terminated: ok {rc=0} 04:00:37.709160 --- ParallelTerminationStrategy: PID 6162 died... 04:00:37.728141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6162): Terminated: ok {rc=0} 04:00:37.772366 --- ParallelTerminationStrategy: PID 6165 died... 04:00:37.791423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6165): Terminated: ok {rc=0} 04:00:37.877510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:00:39.032759 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.045237 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:39.118719 tst iperf3m4.py: using LAC 38399 04:00:39.248432 tst iperf3m4.py: using RAC 149 04:00:39.376922 tst iperf3m4.py: using CellId 38399 04:00:39.505724 tst iperf3m4.py: using BVCI 38400 04:00:39.627046 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.638485 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.649765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.660891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.672330 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.683852 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.695502 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.707013 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:39.718641 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:39.835238 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:39.957914 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:40.075375 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:00:40.198036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:00:40.421118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:40.751641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Launched 04:00:41.040889 run iperf3-srv_10.42.42.10(pid=6168): Launched 04:00:41.166458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:00:41.387808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:41.719205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Launched 04:00:42.007409 run iperf3-srv_10.42.42.10(pid=6170): Launched 04:00:42.131863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:00:42.353036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:42.682739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Launched 04:00:42.970786 run iperf3-srv_10.42.42.10(pid=6172): Launched 04:00:43.095623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:00:43.316814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:00:43.647085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Launched 04:00:43.933756 run iperf3-srv_10.42.42.10(pid=6174): Launched 04:00:44.059656 tst iperf3m4.py:8: start network... 04:00:44.280598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:00:44.790455 run create_hlr_db(pid=6175): Launched 04:00:44.917506 bus /gobi_6: Setting Powered False 04:00:45.984326 run create_hlr_db(pid=6175): Terminated: ok {rc=0} 04:00:46.466967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Launched 04:00:46.806983 run osmo-hlr_10.42.42.2(pid=6178): Launched 04:00:46.962902 run osmo-stp_10.42.42.5: Starting osmo-stp 04:00:47.587826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Launched 04:00:47.916479 run osmo-stp_10.42.42.5(pid=6181): Launched 04:00:48.043337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:00:48.609434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6184): Launched 04:00:48.736823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:00:49.016316 run patchelf(pid=6185): Launched 04:00:49.200057 run osmo-stp_10.42.42.5(pid=6181): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] 04:00:49.339332 run osmo-stp_10.42.42.5(pid=6181): stdout: | (launched: 2022-12-14_04:00:47.855829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:49.479774 run osmo-stp_10.42.42.5(pid=6181): stderr: | [0;m[38;5;43m20221214040048047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040048047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040048048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040048048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040048048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040048049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040048049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:49.620287 run osmo-stp_10.42.42.5(pid=6181): stdout: | (launched: 2022-12-14_04:00:47.855829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:00:49.755203 run osmo-stp_10.42.42.5(pid=6181): stderr: | [0;m[38;5;43m20221214040048047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040048047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040048048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040048048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040048048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040048049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040048049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:00:49.915401 run patchelf(pid=6185): Terminating (SIGINT) 04:00:50.098005 run patchelf(pid=6185): Terminated: ok {rc=0} 04:00:50.229816 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6181): Process ended prematurely: osmo-stp_10.42.42.5(pid=6181) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:00:50.240132 tst iperf3m4.py:8: Test FAILED (11.2 sec) 04:00:50.269233 run osmo-hlr_10.42.42.2(pid=6178): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6178)] 04:00:50.320402 run osmo-hlr_10.42.42.2(pid=6178): stdout: | (launched: 2022-12-14_04:00:46.746669) 04:00:50.372847 run osmo-hlr_10.42.42.2(pid=6178): stderr: | [0;m[1;31m20221214040047135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040047136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040047136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040047136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040047136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040047136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040047157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040047174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040047174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040047174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:00:50.425923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminating (SIGTERM) 04:00:50.468651 run iperf3-srv_10.42.42.10(pid=6168): Terminating (SIGTERM) 04:00:50.511030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminating (SIGTERM) 04:00:50.553723 run iperf3-srv_10.42.42.10(pid=6170): Terminating (SIGTERM) 04:00:50.596478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Terminating (SIGTERM) 04:00:50.639278 run iperf3-srv_10.42.42.10(pid=6172): Terminating (SIGTERM) 04:00:50.681677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Terminating (SIGTERM) 04:00:50.724731 run iperf3-srv_10.42.42.10(pid=6174): Terminating (SIGTERM) 04:00:50.767007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Terminating (SIGTERM) 04:00:50.809803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Terminating (SIGTERM) 04:00:50.852623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6184): Terminating (SIGTERM) 04:00:50.895625 --- ParallelTerminationStrategy: PID 6167 died... 04:00:50.916447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6167): Terminated: ok {rc=0} 04:00:50.964183 --- ParallelTerminationStrategy: PID 6168 died... 04:00:50.984553 run iperf3-srv_10.42.42.10(pid=6168): Terminated {rc=256} 04:00:51.031332 --- ParallelTerminationStrategy: PID 6169 died... 04:00:51.051577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6169): Terminated: ok {rc=0} 04:00:51.098708 --- ParallelTerminationStrategy: PID 6170 died... 04:00:51.119044 run iperf3-srv_10.42.42.10(pid=6170): Terminated {rc=256} 04:00:51.165823 --- ParallelTerminationStrategy: PID 6171 died... 04:00:51.186205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6171): Terminated: ok {rc=0} 04:00:51.233253 --- ParallelTerminationStrategy: PID 6172 died... 04:00:51.253511 run iperf3-srv_10.42.42.10(pid=6172): Terminated {rc=256} 04:00:51.300149 --- ParallelTerminationStrategy: PID 6173 died... 04:00:51.320410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6173): Terminated: ok {rc=0} 04:00:51.367325 --- ParallelTerminationStrategy: PID 6174 died... 04:00:51.388087 run iperf3-srv_10.42.42.10(pid=6174): Terminated {rc=256} 04:00:51.434765 --- ParallelTerminationStrategy: PID 6177 died... 04:00:51.455107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6177): Terminated: ok {rc=0} 04:00:51.502031 --- ParallelTerminationStrategy: PID 6180 died... 04:00:51.522373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6180): Terminated: ok {rc=0} 04:00:51.569056 --- ParallelTerminationStrategy: PID 6184 died... 04:00:51.589444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6184): Terminated: ok {rc=0} 04:00:51.678883 bus /gobi_4: Setting Powered False 04:00:52.778803 bus /gobi_4: Setting Powered False 04:00:53.897001 bus /gobi_1: Setting Powered False 04:00:54.993648 bus /gobi_1: Setting Powered False 04:00:56.109102 bus /gobi_0: Setting Powered False 04:00:57.206607 bus /gobi_0: Setting Powered False 04:00:58.322851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:00:59.428406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:00:59.440882 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:00:59.514951 tst ping.py: using LAC 38400 04:00:59.641909 tst ping.py: using RAC 150 04:00:59.771648 tst ping.py: using CellId 38400 04:00:59.898376 tst ping.py: using BVCI 38401 04:01:00.016261 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.027991 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.039264 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.050654 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.062119 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.073836 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.085653 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:00.097094 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:01:00.216902 tst ping.py:19: start network... 04:01:00.417677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:00.889588 run create_hlr_db(pid=6187): Launched 04:01:01.097793 bus /gobi_6: Setting Powered False 04:01:02.155837 run create_hlr_db(pid=6187): Terminated: ok {rc=0} 04:01:02.611217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6189): Launched 04:01:02.914926 run osmo-hlr_10.42.42.2(pid=6190): Launched 04:01:03.031481 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:03.557473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6192): Launched 04:01:03.858867 run osmo-stp_10.42.42.5(pid=6193): Launched 04:01:03.975408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:04.494198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6195): Launched 04:01:04.609062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:04.863103 run patchelf(pid=6196): Launched 04:01:05.031695 run osmo-stp_10.42.42.5(pid=6193): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6193)] 04:01:05.158617 run osmo-stp_10.42.42.5(pid=6193): stdout: | (launched: 2022-12-14_04:01:03.802882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:05.287765 run osmo-stp_10.42.42.5(pid=6193): stderr: | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040103972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040103972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040103973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040103973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:05.416906 run osmo-stp_10.42.42.5(pid=6193): stdout: | (launched: 2022-12-14_04:01:03.802882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:05.539383 run osmo-stp_10.42.42.5(pid=6193): stderr: | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040103971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040103972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040103972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040103973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040103973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:05.684520 run patchelf(pid=6196): Terminating (SIGINT) 04:01:05.851932 run patchelf(pid=6196): Terminated: ok {rc=0} 04:01:05.972452 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6193): Process ended prematurely: osmo-stp_10.42.42.5(pid=6193) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6193)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 04:01:05.981407 tst ping.py:22: Test FAILED (6.5 sec) 04:01:06.007864 run osmo-hlr_10.42.42.2(pid=6190): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6190)] 04:01:06.055535 run osmo-hlr_10.42.42.2(pid=6190): stdout: | (launched: 2022-12-14_04:01:02.858666) 04:01:06.104815 run osmo-hlr_10.42.42.2(pid=6190): stderr: | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040103035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040103047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040103056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040103056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040103056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:06.154688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6189): Terminating (SIGTERM) 04:01:06.194149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6192): Terminating (SIGTERM) 04:01:06.233592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6195): Terminating (SIGTERM) 04:01:06.273236 --- ParallelTerminationStrategy: PID 6189 died... 04:01:06.292302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6189): Terminated: ok {rc=0} 04:01:06.336128 --- ParallelTerminationStrategy: PID 6192 died... 04:01:06.356206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6192): Terminated: ok {rc=0} 04:01:06.399629 --- ParallelTerminationStrategy: PID 6195 died... 04:01:06.418126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6195): Terminated: ok {rc=0} 04:01:06.504239 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:01:07.593820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:07.606027 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:01:07.678018 tst ping_idle_ping.py: using LAC 38401 04:01:07.797201 tst ping_idle_ping.py: using RAC 151 04:01:07.917289 tst ping_idle_ping.py: using CellId 38401 04:01:08.035740 tst ping_idle_ping.py: using BVCI 38402 04:01:08.146657 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.157598 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.168336 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.179068 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.189698 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.200305 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.211159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:01:08.222002 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:01:08.337686 tst ping_idle_ping.py:24: start network... 04:01:08.556779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:09.061921 run create_hlr_db(pid=6197): Launched 04:01:09.186830 bus /gobi_6: Setting Powered False 04:01:10.250583 run create_hlr_db(pid=6197): Terminated: ok {rc=0} 04:01:10.701912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6199): Launched 04:01:11.027452 run osmo-hlr_10.42.42.2(pid=6200): Launched 04:01:11.151414 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:11.709698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6202): Launched 04:01:12.034988 run osmo-stp_10.42.42.5(pid=6203): Launched 04:01:12.159839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:12.717953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6205): Launched 04:01:12.843336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:13.117344 run patchelf(pid=6206): Launched 04:01:13.297575 run osmo-stp_10.42.42.5(pid=6203): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6203)] 04:01:13.434791 run osmo-stp_10.42.42.5(pid=6203): stdout: | (launched: 2022-12-14_04:01:11.975593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:13.574198 run osmo-stp_10.42.42.5(pid=6203): stderr: | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040112166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:13.713298 run osmo-stp_10.42.42.5(pid=6203): stdout: | (launched: 2022-12-14_04:01:11.975593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:13.846058 run osmo-stp_10.42.42.5(pid=6203): stderr: | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040112166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040112166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040112167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:14.003878 run patchelf(pid=6206): Terminating (SIGINT) 04:01:14.185125 run patchelf(pid=6206): Terminated: ok {rc=0} 04:01:14.315739 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6203): Process ended prematurely: osmo-stp_10.42.42.5(pid=6203) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6203)] [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:01:14.325448 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:01:14.353744 run osmo-hlr_10.42.42.2(pid=6200): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6200)] 04:01:14.404772 run osmo-hlr_10.42.42.2(pid=6200): stdout: | (launched: 2022-12-14_04:01:10.967952) 04:01:14.457486 run osmo-hlr_10.42.42.2(pid=6200): stderr: | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040111164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040111179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040111190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040111190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040111190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:14.510497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6199): Terminating (SIGTERM) 04:01:14.552731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6202): Terminating (SIGTERM) 04:01:14.595691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6205): Terminating (SIGTERM) 04:01:14.638794 --- ParallelTerminationStrategy: PID 6199 died... 04:01:14.659346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6199): Terminated: ok {rc=0} 04:01:14.706488 --- ParallelTerminationStrategy: PID 6202 died... 04:01:14.726512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6202): Terminated: ok {rc=0} 04:01:14.773219 --- ParallelTerminationStrategy: PID 6205 died... 04:01:14.793267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6205): Terminated: ok {rc=0} 04:01:14.882846 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:01:16.207497 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:01:16.214922 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:01:16.251340 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:01:16.292756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:01:16.387913 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:01:16.428513 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:01:16.469731 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:01:17.119956 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:01:17.177360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.190968 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:17.245815 tst cs_paging_gprs_active.py: using LAC 38402 04:01:17.375176 tst cs_paging_gprs_active.py: using RAC 152 04:01:17.506998 tst cs_paging_gprs_active.py: using CellId 38402 04:01:17.638202 tst cs_paging_gprs_active.py: using BVCI 38403 04:01:17.760189 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.771920 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.783361 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.794841 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.807245 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.819371 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.831771 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.844023 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:17.856912 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:17.979347 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:18.102493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:01:18.325844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:18.657337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Launched 04:01:18.947991 run iperf3-srv_10.42.42.10(pid=6211): Launched 04:01:19.073493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:01:19.295588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:19.627099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6212): Launched 04:01:19.916550 run iperf3-srv_10.42.42.10(pid=6213): Launched 04:01:20.042266 tst cs_paging_gprs_active.py:38: start network... 04:01:20.265095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:20.776480 run create_hlr_db(pid=6214): Launched 04:01:20.903516 bus /gobi_6: Setting Powered False 04:01:21.973616 run create_hlr_db(pid=6214): Terminated: ok {rc=0} 04:01:22.411869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6216): Launched 04:01:22.742930 run osmo-hlr_10.42.42.2(pid=6217): Launched 04:01:22.870912 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:23.440516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6219): Launched 04:01:23.769681 run osmo-stp_10.42.42.5(pid=6220): Launched 04:01:23.895372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:24.462696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6222): Launched 04:01:24.590009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:24.868429 run patchelf(pid=6223): Launched 04:01:25.053297 run osmo-stp_10.42.42.5(pid=6220): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6220)] 04:01:25.191930 run osmo-stp_10.42.42.5(pid=6220): stdout: | (launched: 2022-12-14_04:01:23.708569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:25.332430 run osmo-stp_10.42.42.5(pid=6220): stderr: | [0;m[38;5;43m20221214040123902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040123902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040123903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040123903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040123903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040123903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040123904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:25.472761 run osmo-stp_10.42.42.5(pid=6220): stdout: | (launched: 2022-12-14_04:01:23.708569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:25.607681 run osmo-stp_10.42.42.5(pid=6220): stderr: | [0;m[38;5;43m20221214040123902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040123902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040123903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040123903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040123903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040123903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040123904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:25.767434 run patchelf(pid=6223): Terminating (SIGINT) 04:01:25.951098 run patchelf(pid=6223): Terminated: ok {rc=0} 04:01:26.083797 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6220): Process ended prematurely: osmo-stp_10.42.42.5(pid=6220) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6220)] [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:01:26.094263 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:01:26.123047 run osmo-hlr_10.42.42.2(pid=6217): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6217)] 04:01:26.174039 run osmo-hlr_10.42.42.2(pid=6217): stdout: | (launched: 2022-12-14_04:01:22.682747) 04:01:26.226578 run osmo-hlr_10.42.42.2(pid=6217): stderr: | [0;m[1;31m20221214040122879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040122879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040122880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040122880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040122880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040122880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040122896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040122905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040122906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040122906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:26.279711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Terminating (SIGTERM) 04:01:26.322063 run iperf3-srv_10.42.42.10(pid=6211): Terminating (SIGTERM) 04:01:26.364281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6212): Terminating (SIGTERM) 04:01:26.407141 run iperf3-srv_10.42.42.10(pid=6213): Terminating (SIGTERM) 04:01:26.449958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6216): Terminating (SIGTERM) 04:01:26.492349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6219): Terminating (SIGTERM) 04:01:26.534749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6222): Terminating (SIGTERM) 04:01:26.577364 --- ParallelTerminationStrategy: PID 6210 died... 04:01:26.597807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6210): Terminated: ok {rc=0} 04:01:26.644820 --- ParallelTerminationStrategy: PID 6211 died... 04:01:26.664854 run iperf3-srv_10.42.42.10(pid=6211): Terminated {rc=256} 04:01:26.711452 --- ParallelTerminationStrategy: PID 6212 died... 04:01:26.731409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6212): Terminated: ok {rc=0} 04:01:26.777996 --- ParallelTerminationStrategy: PID 6213 died... 04:01:26.797958 run iperf3-srv_10.42.42.10(pid=6213): Terminated {rc=256} 04:01:26.844508 --- ParallelTerminationStrategy: PID 6216 died... 04:01:26.864819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6216): Terminated: ok {rc=0} 04:01:26.911491 --- ParallelTerminationStrategy: PID 6219 died... 04:01:26.931578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6219): Terminated: ok {rc=0} 04:01:26.978157 --- ParallelTerminationStrategy: PID 6222 died... 04:01:26.998311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6222): Terminated: ok {rc=0} 04:01:27.086922 bus /gobi_0: Setting Powered False 04:01:28.186350 bus /gobi_0: Setting Powered False 04:01:29.302480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:01:30.450184 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:30.462655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:30.518307 tst iperf3.py: using LAC 38403 04:01:30.643436 tst iperf3.py: using RAC 153 04:01:30.765073 tst iperf3.py: using CellId 38403 04:01:30.892498 tst iperf3.py: using BVCI 38404 04:01:31.022187 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.035385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.048386 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.061479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.075174 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.089108 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.103737 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.117566 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:31.132124 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:31.257493 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:01:31.488392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:31.829177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6224): Launched 04:01:32.137734 run iperf3-srv_10.42.42.10(pid=6225): Launched 04:01:32.263903 tst iperf3.py:8: start network... 04:01:32.486502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:32.998115 run create_hlr_db(pid=6226): Launched 04:01:33.126309 bus /gobi_6: Setting Powered False 04:01:34.190897 run create_hlr_db(pid=6226): Terminated: ok {rc=0} 04:01:34.646072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6228): Launched 04:01:34.976439 run osmo-hlr_10.42.42.2(pid=6229): Launched 04:01:35.103459 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:35.674766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6231): Launched 04:01:36.004580 run osmo-stp_10.42.42.5(pid=6232): Launched 04:01:36.131638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:36.699359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6234): Launched 04:01:36.826419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:37.105190 run patchelf(pid=6235): Launched 04:01:37.287588 run osmo-stp_10.42.42.5(pid=6232): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6232)] 04:01:37.426843 run osmo-stp_10.42.42.5(pid=6232): stdout: | (launched: 2022-12-14_04:01:35.943943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:37.567858 run osmo-stp_10.42.42.5(pid=6232): stderr: | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040136136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:37.708364 run osmo-stp_10.42.42.5(pid=6232): stdout: | (launched: 2022-12-14_04:01:35.943943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:37.843122 run osmo-stp_10.42.42.5(pid=6232): stderr: | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040136136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040136136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040136137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:38.003342 run patchelf(pid=6235): Terminating (SIGINT) 04:01:38.186834 run patchelf(pid=6235): Terminated: ok {rc=0} 04:01:38.318874 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6232): Process ended prematurely: osmo-stp_10.42.42.5(pid=6232) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6232)] [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:01:38.329245 tst iperf3.py:8: Test FAILED (7.9 sec) 04:01:38.358065 run osmo-hlr_10.42.42.2(pid=6229): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6229)] 04:01:38.408698 run osmo-hlr_10.42.42.2(pid=6229): stdout: | (launched: 2022-12-14_04:01:34.915831) 04:01:38.460920 run osmo-hlr_10.42.42.2(pid=6229): stderr: | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040135116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040135131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040135139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040135140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040135140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:38.513681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6224): Terminating (SIGTERM) 04:01:38.555836 run iperf3-srv_10.42.42.10(pid=6225): Terminating (SIGTERM) 04:01:38.597907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6228): Terminating (SIGTERM) 04:01:38.640453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6231): Terminating (SIGTERM) 04:01:38.682960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6234): Terminating (SIGTERM) 04:01:38.725741 --- ParallelTerminationStrategy: PID 6224 died... 04:01:38.746163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6224): Terminated: ok {rc=0} 04:01:38.792644 --- ParallelTerminationStrategy: PID 6225 died... 04:01:38.812516 run iperf3-srv_10.42.42.10(pid=6225): Terminated {rc=256} 04:01:38.858523 --- ParallelTerminationStrategy: PID 6228 died... 04:01:38.878571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6228): Terminated: ok {rc=0} 04:01:38.924795 --- ParallelTerminationStrategy: PID 6231 died... 04:01:38.945081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6231): Terminated: ok {rc=0} 04:01:38.991121 --- ParallelTerminationStrategy: PID 6234 died... 04:01:39.010998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6234): Terminated: ok {rc=0} 04:01:39.099641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:01:40.248617 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.260786 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:01:40.313382 tst iperf3m4.py: using LAC 38404 04:01:40.436240 tst iperf3m4.py: using RAC 154 04:01:40.559725 tst iperf3m4.py: using CellId 38404 04:01:40.683337 tst iperf3m4.py: using BVCI 38405 04:01:40.797611 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.809168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.820372 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.831449 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.843180 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.854881 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.866949 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.878791 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:01:40.890653 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:41.013458 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:41.137404 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:41.256640 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:01:41.379975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:01:41.602849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:41.934695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Launched 04:01:42.222595 run iperf3-srv_10.42.42.10(pid=6237): Launched 04:01:42.348071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:01:42.569806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:42.900619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Launched 04:01:43.189531 run iperf3-srv_10.42.42.10(pid=6239): Launched 04:01:43.313365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:01:43.535016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:43.865932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Launched 04:01:44.151819 run iperf3-srv_10.42.42.10(pid=6241): Launched 04:01:44.276012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:01:44.496862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:01:44.827068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6242): Launched 04:01:45.114984 run iperf3-srv_10.42.42.10(pid=6243): Launched 04:01:45.239500 tst iperf3m4.py:8: start network... 04:01:45.460065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:01:45.971041 run create_hlr_db(pid=6244): Launched 04:01:46.123229 bus /gobi_6: Setting Powered False 04:01:47.189590 run create_hlr_db(pid=6244): Terminated: ok {rc=0} 04:01:47.649154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6246): Launched 04:01:47.979852 run osmo-hlr_10.42.42.2(pid=6247): Launched 04:01:48.107878 run osmo-stp_10.42.42.5: Starting osmo-stp 04:01:48.682216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6249): Launched 04:01:49.011801 run osmo-stp_10.42.42.5(pid=6250): Launched 04:01:49.138522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:01:49.702234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6252): Launched 04:01:49.828848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:01:50.106737 run patchelf(pid=6253): Launched 04:01:50.289347 run osmo-stp_10.42.42.5(pid=6250): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6250)] 04:01:50.427982 run osmo-stp_10.42.42.5(pid=6250): stdout: | (launched: 2022-12-14_04:01:48.951654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:50.567978 run osmo-stp_10.42.42.5(pid=6250): stderr: | [0;m[38;5;43m20221214040149139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040149139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040149140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040149140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040149140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040149140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040149141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:50.708012 run osmo-stp_10.42.42.5(pid=6250): stdout: | (launched: 2022-12-14_04:01:48.951654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:01:50.842497 run osmo-stp_10.42.42.5(pid=6250): stderr: | [0;m[38;5;43m20221214040149139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040149139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040149140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040149140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040149140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040149140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040149141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:01:51.002462 run patchelf(pid=6253): Terminating (SIGINT) 04:01:51.185184 run patchelf(pid=6253): Terminated: ok {rc=0} 04:01:51.316837 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6250): Process ended prematurely: osmo-stp_10.42.42.5(pid=6250) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6250)] [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:01:51.327277 tst iperf3m4.py:8: Test FAILED (11.1 sec) 04:01:51.356135 run osmo-hlr_10.42.42.2(pid=6247): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6247)] 04:01:51.406875 run osmo-hlr_10.42.42.2(pid=6247): stdout: | (launched: 2022-12-14_04:01:47.918975) 04:01:51.458863 run osmo-hlr_10.42.42.2(pid=6247): stderr: | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040148115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040148127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040148135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040148136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040148136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:01:51.511267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Terminating (SIGTERM) 04:01:51.553325 run iperf3-srv_10.42.42.10(pid=6237): Terminating (SIGTERM) 04:01:51.594976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Terminating (SIGTERM) 04:01:51.637793 run iperf3-srv_10.42.42.10(pid=6239): Terminating (SIGTERM) 04:01:51.679946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminating (SIGTERM) 04:01:51.722541 run iperf3-srv_10.42.42.10(pid=6241): Terminating (SIGTERM) 04:01:51.764637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6242): Terminating (SIGTERM) 04:01:51.807067 run iperf3-srv_10.42.42.10(pid=6243): Terminating (SIGTERM) 04:01:51.849213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6246): Terminating (SIGTERM) 04:01:51.891735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6249): Terminating (SIGTERM) 04:01:51.934194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6252): Terminating (SIGTERM) 04:01:51.976228 --- ParallelTerminationStrategy: PID 6236 died... 04:01:51.996550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6236): Terminated: ok {rc=0} 04:01:52.042809 --- ParallelTerminationStrategy: PID 6237 died... 04:01:52.062537 run iperf3-srv_10.42.42.10(pid=6237): Terminated {rc=256} 04:01:52.108381 --- ParallelTerminationStrategy: PID 6238 died... 04:01:52.128152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6238): Terminated: ok {rc=0} 04:01:52.174162 --- ParallelTerminationStrategy: PID 6239 died... 04:01:52.194020 run iperf3-srv_10.42.42.10(pid=6239): Terminated {rc=256} 04:01:52.239833 --- ParallelTerminationStrategy: PID 6240 died... 04:01:52.259564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6240): Terminated: ok {rc=0} 04:01:52.305449 --- ParallelTerminationStrategy: PID 6241 died... 04:01:52.325178 run iperf3-srv_10.42.42.10(pid=6241): Terminated {rc=256} 04:01:52.371098 --- ParallelTerminationStrategy: PID 6242 died... 04:01:52.390873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6242): Terminated: ok {rc=0} 04:01:52.437084 --- ParallelTerminationStrategy: PID 6243 died... 04:01:52.456792 run iperf3-srv_10.42.42.10(pid=6243): Terminated {rc=256} 04:01:52.502681 --- ParallelTerminationStrategy: PID 6246 died... 04:01:52.522607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6246): Terminated: ok {rc=0} 04:01:52.568782 --- ParallelTerminationStrategy: PID 6249 died... 04:01:52.589023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6249): Terminated: ok {rc=0} 04:01:52.635053 --- ParallelTerminationStrategy: PID 6252 died... 04:01:52.654903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6252): Terminated: ok {rc=0} 04:01:52.742334 bus /gobi_4: Setting Powered False 04:01:53.841352 bus /gobi_4: Setting Powered False 04:01:54.956614 bus /gobi_1: Setting Powered False 04:01:56.055497 bus /gobi_1: Setting Powered False 04:01:57.172559 bus /gobi_0: Setting Powered False 04:01:58.271387 bus /gobi_0: Setting Powered False 04:01:59.390339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:02:00.494573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:00.507052 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:02:00.565342 tst ping.py: using LAC 38405 04:02:00.690343 tst ping.py: using RAC 155 04:02:00.813783 tst ping.py: using CellId 38405 04:02:00.941957 tst ping.py: using BVCI 38406 04:02:01.078915 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.091667 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.104050 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.116277 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.128419 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.140883 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.152745 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:01.164421 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:02:01.301342 tst ping.py:19: start network... 04:02:01.570446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:02.106911 run create_hlr_db(pid=6254): Launched 04:02:02.262102 bus /gobi_6: Setting Powered False 04:02:03.325922 run create_hlr_db(pid=6254): Terminated: ok {rc=0} 04:02:03.754768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6256): Launched 04:02:04.055627 run osmo-hlr_10.42.42.2(pid=6257): Launched 04:02:04.169573 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:04.704819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6259): Launched 04:02:05.006828 run osmo-stp_10.42.42.5(pid=6260): Launched 04:02:05.123716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:05.644174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6262): Launched 04:02:05.759775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:06.013721 run patchelf(pid=6263): Launched 04:02:06.181408 run osmo-stp_10.42.42.5(pid=6260): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6260)] 04:02:06.308818 run osmo-stp_10.42.42.5(pid=6260): stdout: | (launched: 2022-12-14_04:02:04.950416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:06.438414 run osmo-stp_10.42.42.5(pid=6260): stderr: | [0;m[38;5;43m20221214040205120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040205121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040205121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040205121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:06.568217 run osmo-stp_10.42.42.5(pid=6260): stdout: | (launched: 2022-12-14_04:02:04.950416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:06.691725 run osmo-stp_10.42.42.5(pid=6260): stderr: | [0;m[38;5;43m20221214040205120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040205121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040205121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040205121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040205122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:06.838160 run patchelf(pid=6263): Terminating (SIGINT) 04:02:07.007963 run patchelf(pid=6263): Terminated: ok {rc=0} 04:02:07.130040 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6260): Process ended prematurely: osmo-stp_10.42.42.5(pid=6260) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6260)] [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:02:07.138941 tst ping.py:22: Test FAILED (6.6 sec) 04:02:07.165712 run osmo-hlr_10.42.42.2(pid=6257): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6257)] 04:02:07.213830 run osmo-hlr_10.42.42.2(pid=6257): stdout: | (launched: 2022-12-14_04:02:03.999487) 04:02:07.262884 run osmo-hlr_10.42.42.2(pid=6257): stderr: | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040204174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040204186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040204195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040204195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040204196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:07.312540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6256): Terminating (SIGTERM) 04:02:07.352104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6259): Terminating (SIGTERM) 04:02:07.391518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6262): Terminating (SIGTERM) 04:02:07.431289 --- ParallelTerminationStrategy: PID 6256 died... 04:02:07.450329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6256): Terminated: ok {rc=0} 04:02:07.494127 --- ParallelTerminationStrategy: PID 6259 died... 04:02:07.512524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6259): Terminated: ok {rc=0} 04:02:07.556355 --- ParallelTerminationStrategy: PID 6262 died... 04:02:07.575017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6262): Terminated: ok {rc=0} 04:02:07.660424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:02:08.749776 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:08.763057 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:02:08.823003 tst ping_idle_ping.py: using LAC 38406 04:02:08.949194 tst ping_idle_ping.py: using RAC 156 04:02:09.073369 tst ping_idle_ping.py: using CellId 38406 04:02:09.197422 tst ping_idle_ping.py: using BVCI 38407 04:02:09.314354 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.326379 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.338011 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.349809 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.361665 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.373654 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.385740 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:02:09.397698 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:02:09.518749 tst ping_idle_ping.py:24: start network... 04:02:09.735399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:10.237457 run create_hlr_db(pid=6264): Launched 04:02:10.363527 bus /gobi_6: Setting Powered False 04:02:11.427329 run create_hlr_db(pid=6264): Terminated: ok {rc=0} 04:02:11.859365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Launched 04:02:12.163217 run osmo-hlr_10.42.42.2(pid=6267): Launched 04:02:12.279365 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:12.801844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Launched 04:02:13.107373 run osmo-stp_10.42.42.5(pid=6270): Launched 04:02:13.223886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:13.743561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Launched 04:02:13.858635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:14.113431 run patchelf(pid=6273): Launched 04:02:14.281935 run osmo-stp_10.42.42.5(pid=6270): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] 04:02:14.409085 run osmo-stp_10.42.42.5(pid=6270): stdout: | (launched: 2022-12-14_04:02:13.051045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:14.538161 run osmo-stp_10.42.42.5(pid=6270): stderr: | [0;m[38;5;43m20221214040213222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040213222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040213223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040213223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040213223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040213224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040213224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:14.667359 run osmo-stp_10.42.42.5(pid=6270): stdout: | (launched: 2022-12-14_04:02:13.051045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:14.790192 run osmo-stp_10.42.42.5(pid=6270): stderr: | [0;m[38;5;43m20221214040213222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040213222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040213223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040213223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040213223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040213224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040213224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:14.935748 run patchelf(pid=6273): Terminating (SIGINT) 04:02:15.104253 run patchelf(pid=6273): Terminated: ok {rc=0} 04:02:15.225751 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6270): Process ended prematurely: osmo-stp_10.42.42.5(pid=6270) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:02:15.234863 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:02:15.261701 run osmo-hlr_10.42.42.2(pid=6267): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6267)] 04:02:15.309562 run osmo-hlr_10.42.42.2(pid=6267): stdout: | (launched: 2022-12-14_04:02:12.107093) 04:02:15.359052 run osmo-hlr_10.42.42.2(pid=6267): stderr: | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040212283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040212296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040212306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040212306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040212306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:15.408930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Terminating (SIGTERM) 04:02:15.448429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Terminating (SIGTERM) 04:02:15.488005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Terminating (SIGTERM) 04:02:15.527712 --- ParallelTerminationStrategy: PID 6266 died... 04:02:15.546800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6266): Terminated: ok {rc=0} 04:02:15.590455 --- ParallelTerminationStrategy: PID 6269 died... 04:02:15.608926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6269): Terminated: ok {rc=0} 04:02:15.652806 --- ParallelTerminationStrategy: PID 6272 died... 04:02:15.671789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6272): Terminated: ok {rc=0} 04:02:15.758246 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:02:17.071329 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:17.079843 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:02:17.122275 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:02:17.166761 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:02:17.226938 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:02:17.260914 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:02:17.297262 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:02:17.857290 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:02:17.862625 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:17.874511 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:02:17.946263 tst switch_tch_pdch.py: using LAC 38407 04:02:18.073111 tst switch_tch_pdch.py: using RAC 157 04:02:18.198588 tst switch_tch_pdch.py: using CellId 38407 04:02:18.323567 tst switch_tch_pdch.py: using BVCI 38408 04:02:18.433743 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.445138 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.456056 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.467069 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.478641 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.490291 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.502060 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:02:18.513641 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:02:18.635384 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:02:18.753669 tst switch_tch_pdch.py:51: start network... 04:02:18.953443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:19.417575 run create_hlr_db(pid=6278): Launched 04:02:19.545562 bus /gobi_6: Setting Powered False 04:02:20.609166 run create_hlr_db(pid=6278): Terminated: ok {rc=0} 04:02:21.039654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6280): Launched 04:02:21.341546 run osmo-hlr_10.42.42.2(pid=6281): Launched 04:02:21.456095 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:21.993457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6283): Launched 04:02:22.295272 run osmo-stp_10.42.42.5(pid=6284): Launched 04:02:22.410533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:22.929079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6286): Launched 04:02:23.043333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:23.298555 run patchelf(pid=6287): Launched 04:02:23.465131 run osmo-stp_10.42.42.5(pid=6284): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6284)] 04:02:23.591895 run osmo-stp_10.42.42.5(pid=6284): stdout: | (launched: 2022-12-14_04:02:22.239116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:23.720644 run osmo-stp_10.42.42.5(pid=6284): stderr: | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040222411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:23.849117 run osmo-stp_10.42.42.5(pid=6284): stdout: | (launched: 2022-12-14_04:02:22.239116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:23.971777 run osmo-stp_10.42.42.5(pid=6284): stderr: | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040222410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040222411 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040222411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:24.117019 run patchelf(pid=6287): Terminating (SIGINT) 04:02:24.284189 run patchelf(pid=6287): Terminated: ok {rc=0} 04:02:24.404659 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6284): Process ended prematurely: osmo-stp_10.42.42.5(pid=6284) [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6284)] [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:02:24.413731 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:02:24.440710 run osmo-hlr_10.42.42.2(pid=6281): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6281)] 04:02:24.488486 run osmo-hlr_10.42.42.2(pid=6281): stdout: | (launched: 2022-12-14_04:02:21.285087) 04:02:24.537716 run osmo-hlr_10.42.42.2(pid=6281): stderr: | [0;m[1;31m20221214040221463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040221463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040221463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040221463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040221463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040221464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040221475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040221486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040221486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040221486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:24.587121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6280): Terminating (SIGTERM) 04:02:24.627025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6283): Terminating (SIGTERM) 04:02:24.666806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6286): Terminating (SIGTERM) 04:02:24.706712 --- ParallelTerminationStrategy: PID 6280 died... 04:02:24.725485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6280): Terminated: ok {rc=0} 04:02:24.769468 --- ParallelTerminationStrategy: PID 6283 died... 04:02:24.787929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6283): Terminated: ok {rc=0} 04:02:24.831706 --- ParallelTerminationStrategy: PID 6286 died... 04:02:24.850243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6286): Terminated: ok {rc=0} 04:02:24.936106 bus /gobi_0: Setting Powered False 04:02:26.034159 bus /gobi_0: Setting Powered False 04:02:27.151803 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:02:28.404630 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:28.410611 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:02:28.443581 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:02:28.477859 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:02:28.528853 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:02:28.562191 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:02:28.596867 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:02:29.153337 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:02:29.158400 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.169513 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:02:29.239362 tst switch_tch_pdch.py: using LAC 38408 04:02:29.356844 tst switch_tch_pdch.py: using RAC 158 04:02:29.473213 tst switch_tch_pdch.py: using CellId 38408 04:02:29.588808 tst switch_tch_pdch.py: using BVCI 38409 04:02:29.697234 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.708189 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.718906 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.729697 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.740341 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.751564 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.762862 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:02:29.773605 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:02:29.894530 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:02:30.011565 tst switch_tch_pdch.py:51: start network... 04:02:30.212321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:30.651752 run create_hlr_db(pid=6291): Launched 04:02:30.774810 bus /gobi_6: Setting Powered False 04:02:31.838121 run create_hlr_db(pid=6291): Terminated: ok {rc=0} 04:02:32.270476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6293): Launched 04:02:32.594391 run osmo-hlr_10.42.42.2(pid=6294): Launched 04:02:32.718659 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:33.249867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6296): Launched 04:02:33.573946 run osmo-stp_10.42.42.5(pid=6297): Launched 04:02:33.697811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:02:34.225474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6299): Launched 04:02:34.349461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:02:34.622660 run patchelf(pid=6300): Launched 04:02:34.803151 run osmo-stp_10.42.42.5(pid=6297): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6297)] 04:02:34.939533 run osmo-stp_10.42.42.5(pid=6297): stdout: | (launched: 2022-12-14_04:02:33.514650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:35.078135 run osmo-stp_10.42.42.5(pid=6297): stderr: | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040233708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:35.216346 run osmo-stp_10.42.42.5(pid=6297): stdout: | (launched: 2022-12-14_04:02:33.514650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:35.348107 run osmo-stp_10.42.42.5(pid=6297): stderr: | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040233708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040233708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040233709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:35.504324 run patchelf(pid=6300): Terminating (SIGINT) 04:02:35.683653 run patchelf(pid=6300): Terminated: ok {rc=0} 04:02:35.812713 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6297): Process ended prematurely: osmo-stp_10.42.42.5(pid=6297) [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6297)] [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:02:35.822522 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:02:35.850651 run osmo-hlr_10.42.42.2(pid=6294): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6294)] 04:02:35.902053 run osmo-hlr_10.42.42.2(pid=6294): stdout: | (launched: 2022-12-14_04:02:32.535012) 04:02:35.954571 run osmo-hlr_10.42.42.2(pid=6294): stderr: | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040232732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040232744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040232754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040232754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040232754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:36.007167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6293): Terminating (SIGTERM) 04:02:36.049330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6296): Terminating (SIGTERM) 04:02:36.091763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6299): Terminating (SIGTERM) 04:02:36.134525 --- ParallelTerminationStrategy: PID 6293 died... 04:02:36.154871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6293): Terminated: ok {rc=0} 04:02:36.201485 --- ParallelTerminationStrategy: PID 6296 died... 04:02:36.221503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6296): Terminated: ok {rc=0} 04:02:36.267919 --- ParallelTerminationStrategy: PID 6299 died... 04:02:36.287855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6299): Terminated: ok {rc=0} 04:02:36.377028 bus /gobi_0: Setting Powered False 04:02:37.476197 bus /gobi_0: Setting Powered False 04:02:38.595017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:39.849625 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:39.853967 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:39.887550 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:02:39.894806 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:39.947575 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:39.981731 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:02:39.988597 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:40.524199 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:40.529707 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:02:40.540645 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:40.591217 tst mo_mt_sms.py: using LAC 38409 04:02:40.708115 tst mo_mt_sms.py: using RAC 159 04:02:40.823703 tst mo_mt_sms.py: using CellId 38409 04:02:40.939428 tst mo_mt_sms.py: using BVCI 38410 04:02:41.047640 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:41.166888 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:41.281798 tst mo_mt_sms.py:9: start nitb and bts... 04:02:41.483536 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:02:42.097092 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6304): Launched 04:02:42.398673 run osmo-nitb_10.42.42.2(pid=6305): Launched 04:02:42.567214 run osmo-nitb_10.42.42.2(pid=6305): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6305)] 04:02:42.702760 run osmo-nitb_10.42.42.2(pid=6305): stdout: | (launched: 2022-12-14_04:02:42.342589) 04:02:42.839281 run osmo-nitb_10.42.42.2(pid=6305): stderr: | (launched: 2022-12-14_04:02:42.387287) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:42.976157 run osmo-nitb_10.42.42.2(pid=6305): stdout: | (launched: 2022-12-14_04:02:42.342589) 04:02:43.106373 run osmo-nitb_10.42.42.2(pid=6305): stderr: | (launched: 2022-12-14_04:02:42.387287) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6305) [trial-2399↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6305)] 04:02:43.514531 tst osmo-nitb_10.42.42.2(pid=6305): stdout: | (launched: 2022-12-14_04:02:42.342589) 04:02:43.635890 tst osmo-nitb_10.42.42.2(pid=6305): stderr: | (launched: 2022-12-14_04:02:42.387287) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:02:43.778524 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6305) [trial-2399↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6305)] [trial-2399↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 04:02:43.787152 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:02:43.793936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6304): Terminating (SIGTERM) 04:02:44.003006 --- ParallelTerminationStrategy: PID 6304 died... 04:02:44.023935 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6304): Terminated: ok {rc=0} 04:02:44.108902 bus /sierra_3: Setting Powered False 04:02:45.209721 bus /sierra_3: Setting Powered False 04:02:46.338091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:47.539301 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:47.543634 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:47.578147 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:02:47.608007 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:02:47.660878 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:47.695327 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:02:47.722780 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:02:48.273632 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 04:02:48.279430 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.290649 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:48.340750 tst mo_mt_sms.py: using LAC 38410 04:02:48.458291 tst mo_mt_sms.py: using RAC 160 04:02:48.573860 tst mo_mt_sms.py: using CellId 38410 04:02:48.689932 tst mo_mt_sms.py: using BVCI 38411 04:02:48.800198 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.811047 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.821658 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.832087 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.842638 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:02:48.853533 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:48.967326 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:02:49.080522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:02:49.547417 run create_hlr_db(pid=6309): Launched 04:02:49.670463 bus /sierra_2: Setting Powered False 04:02:50.731091 run create_hlr_db(pid=6309): Terminated: ok {rc=0} 04:02:51.151185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6311): Launched 04:02:51.453721 run osmo-hlr_10.42.42.2(pid=6312): Launched 04:02:51.568843 run osmo-stp_10.42.42.5: Starting osmo-stp 04:02:52.090182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6314): Launched 04:02:52.392903 run osmo-stp_10.42.42.5(pid=6315): Launched 04:02:52.508206 run osmo-msc_10.42.42.6: Starting osmo-msc 04:02:53.051179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Launched 04:02:53.351719 run osmo-msc_10.42.42.6(pid=6318): Launched 04:02:53.519158 run osmo-stp_10.42.42.5(pid=6315): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6315)] 04:02:53.645500 run osmo-stp_10.42.42.5(pid=6315): stdout: | (launched: 2022-12-14_04:02:52.335991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:53.771735 run osmo-stp_10.42.42.5(pid=6315): stderr: | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040252507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:53.896932 run osmo-stp_10.42.42.5(pid=6315): stdout: | (launched: 2022-12-14_04:02:52.335991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:02:54.015308 run osmo-stp_10.42.42.5(pid=6315): stderr: | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040252506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040252507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040252507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:02:54.157873 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6315): Process ended prematurely: osmo-stp_10.42.42.5(pid=6315) [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6315)] [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 04:02:54.166175 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:02:54.192121 run osmo-hlr_10.42.42.2(pid=6312): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6312)] 04:02:54.239679 run osmo-hlr_10.42.42.2(pid=6312): stdout: | (launched: 2022-12-14_04:02:51.397464) 04:02:54.288915 run osmo-hlr_10.42.42.2(pid=6312): stderr: | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040251574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040251587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040251596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040251596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040251596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:02:54.357819 run osmo-msc_10.42.42.6(pid=6318): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6318)] 04:02:54.405334 run osmo-msc_10.42.42.6(pid=6318): stdout: | (launched: 2022-12-14_04:02:53.295054) 04:02:54.454200 run osmo-msc_10.42.42.6(pid=6318): stderr: | [0;m[38;5;43m20221214040253566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040253566 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25861f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040253566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040253566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040253567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040253567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040253569 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040253569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040253570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040253570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:02:54.503886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6311): Terminating (SIGTERM) 04:02:54.543497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6314): Terminating (SIGTERM) 04:02:54.582942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Terminating (SIGTERM) 04:02:54.622791 --- ParallelTerminationStrategy: PID 6311 died... 04:02:54.641963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6311): Terminated: ok {rc=0} 04:02:54.685839 --- ParallelTerminationStrategy: PID 6314 died... 04:02:54.704233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6314): Terminated: ok {rc=0} 04:02:54.747854 --- ParallelTerminationStrategy: PID 6317 died... 04:02:54.766497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Terminated: ok {rc=0} 04:02:54.852657 bus /sierra_3: Setting Powered False 04:02:55.953108 bus /sierra_3: Setting Powered False 04:02:57.068615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:02:58.300802 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:02:58.304627 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:02:58.338109 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 04:02:58.345174 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:02:58.383565 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:02:58.419592 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 04:02:58.427341 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:02:58.942875 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:02:58.948052 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 04:02:58.959607 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:02:59.011192 tst assert_extension.py: using LAC 38411 04:02:59.130219 tst assert_extension.py: using RAC 161 04:02:59.250031 tst assert_extension.py: using CellId 38411 04:02:59.368576 tst assert_extension.py: using BVCI 38412 04:02:59.478176 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:02:59.595804 tst assert_extension.py:10: start nitb and bts... 04:02:59.811950 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:03:00.472111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6323): Launched 04:03:00.795229 run osmo-nitb_10.42.42.2(pid=6324): Launched 04:03:00.996707 run osmo-nitb_10.42.42.2(pid=6324): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6324)] 04:03:01.143909 run osmo-nitb_10.42.42.2(pid=6324): stdout: | (launched: 2022-12-14_04:03:00.735807) 04:03:01.292616 run osmo-nitb_10.42.42.2(pid=6324): stderr: | (launched: 2022-12-14_04:03:00.783649) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:03:01.443144 run osmo-nitb_10.42.42.2(pid=6324): stdout: | (launched: 2022-12-14_04:03:00.735807) 04:03:01.585248 run osmo-nitb_10.42.42.2(pid=6324): stderr: | (launched: 2022-12-14_04:03:00.783649) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6324): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6324) [trial-2399↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6324)] 04:03:01.937713 tst osmo-nitb_10.42.42.2(pid=6324): stdout: | (launched: 2022-12-14_04:03:00.735807) 04:03:02.131598 tst osmo-nitb_10.42.42.2(pid=6324): stderr: | (launched: 2022-12-14_04:03:00.783649) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:03:02.282938 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6324): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6324) [trial-2399↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6324)] [trial-2399↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 04:03:02.293216 tst assert_extension.py:12: Test FAILED (3.3 sec) 04:03:02.301702 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6323): Terminating (SIGTERM) 04:03:02.517047 --- ParallelTerminationStrategy: PID 6323 died... 04:03:02.539178 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6323): Terminated: ok {rc=0} 04:03:02.629634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 04:03:03.814218 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:03.818750 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:03:03.853248 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:03:03.882657 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 04:03:03.919451 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:03:03.954722 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:03:03.981303 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 04:03:04.513776 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 04:03:04.518942 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:04.530025 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:03:04.578257 tst assert_extension.py: using LAC 38412 04:03:04.704111 tst assert_extension.py: using RAC 162 04:03:04.828813 tst assert_extension.py: using CellId 38412 04:03:04.953249 tst assert_extension.py: using BVCI 38413 04:03:05.071900 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:05.083296 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:05.094663 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:05.105712 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:05.117104 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:03:05.128393 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 04:03:05.249423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:05.750718 run create_hlr_db(pid=6333): Launched 04:03:05.873656 bus /sierra_2: Setting Powered False 04:03:06.937390 run create_hlr_db(pid=6333): Terminated: ok {rc=0} 04:03:07.368692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6335): Launched 04:03:07.671883 run osmo-hlr_10.42.42.2(pid=6336): Launched 04:03:07.786572 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:08.408248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6338): Launched 04:03:08.704475 run osmo-stp_10.42.42.5(pid=6339): Launched 04:03:08.816840 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:09.352741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6341): Launched 04:03:09.649656 run osmo-msc_10.42.42.6(pid=6342): Launched 04:03:09.814724 run osmo-stp_10.42.42.5(pid=6339): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6339)] 04:03:09.941208 run osmo-stp_10.42.42.5(pid=6339): stdout: | (launched: 2022-12-14_04:03:08.649458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:10.066956 run osmo-stp_10.42.42.5(pid=6339): stderr: | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040308819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:10.190875 run osmo-stp_10.42.42.5(pid=6339): stdout: | (launched: 2022-12-14_04:03:08.649458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:10.309247 run osmo-stp_10.42.42.5(pid=6339): stderr: | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040308818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040308819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040308819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:10.450610 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6339): Process ended prematurely: osmo-stp_10.42.42.5(pid=6339) [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6339)] [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py:17] 04:03:10.458823 tst assert_extension.py:17: Test FAILED (5.9 sec) 04:03:10.484724 run osmo-hlr_10.42.42.2(pid=6336): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6336)] 04:03:10.532743 run osmo-hlr_10.42.42.2(pid=6336): stdout: | (launched: 2022-12-14_04:03:07.615848) 04:03:10.582040 run osmo-hlr_10.42.42.2(pid=6336): stderr: | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040307792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040307807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040307818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040307818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040307818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:10.650740 run osmo-msc_10.42.42.6(pid=6342): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6342)] 04:03:10.698380 run osmo-msc_10.42.42.6(pid=6342): stdout: | (launched: 2022-12-14_04:03:09.594443) 04:03:10.747444 run osmo-msc_10.42.42.6(pid=6342): stderr: | [0;m[38;5;43m20221214040309865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040309865 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f213e8c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040309866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040309866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040309866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040309866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040309868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040309868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040309868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040309868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:10.797153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6335): Terminating (SIGTERM) 04:03:10.836809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6338): Terminating (SIGTERM) 04:03:10.876087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6341): Terminating (SIGTERM) 04:03:10.915539 --- ParallelTerminationStrategy: PID 6335 died... 04:03:10.934719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6335): Terminated: ok {rc=0} 04:03:10.978332 --- ParallelTerminationStrategy: PID 6338 died... 04:03:10.996625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6338): Terminated: ok {rc=0} 04:03:11.039901 --- ParallelTerminationStrategy: PID 6341 died... 04:03:11.058315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6341): Terminated: ok {rc=0} 04:03:11.143520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:03:12.357218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:12.365542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:03:12.399460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:03:12.425861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:03:12.481338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:03:12.514718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:03:12.541136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:03:13.089429 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:03:13.139124 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.150628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:03:13.220375 tst mo_mt_call.py: using LAC 38413 04:03:13.338299 tst mo_mt_call.py: using RAC 163 04:03:13.457043 tst mo_mt_call.py: using CellId 38413 04:03:13.575558 tst mo_mt_call.py: using BVCI 38414 04:03:13.685453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.696666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.707676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.718891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.730663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:13.742436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:13.862919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:13.978694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:14.447650 run create_hlr_db(pid=6347): Launched 04:03:14.571556 bus /sierra_2: Setting Powered False 04:03:15.632441 run create_hlr_db(pid=6347): Terminated: ok {rc=0} 04:03:16.085717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6349): Launched 04:03:16.442024 run osmo-hlr_10.42.42.2(pid=6350): Launched 04:03:16.729038 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:17.368320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6352): Launched 04:03:17.693918 run osmo-stp_10.42.42.5(pid=6353): Launched 04:03:17.820425 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:18.408226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6355): Launched 04:03:18.734468 run osmo-msc_10.42.42.6(pid=6356): Launched 04:03:18.917583 run osmo-stp_10.42.42.5(pid=6353): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6353)] 04:03:19.055407 run osmo-stp_10.42.42.5(pid=6353): stdout: | (launched: 2022-12-14_04:03:17.634267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:19.193155 run osmo-stp_10.42.42.5(pid=6353): stderr: | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040317828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:19.329659 run osmo-stp_10.42.42.5(pid=6353): stdout: | (launched: 2022-12-14_04:03:17.634267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:19.458289 run osmo-stp_10.42.42.5(pid=6353): stderr: | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040317827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040317828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040317828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:19.613291 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6353): Process ended prematurely: osmo-stp_10.42.42.5(pid=6353) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6353)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:03:19.622991 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:03:19.650912 run osmo-hlr_10.42.42.2(pid=6350): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6350)] 04:03:19.701919 run osmo-hlr_10.42.42.2(pid=6350): stdout: | (launched: 2022-12-14_04:03:16.383704) 04:03:19.754417 run osmo-hlr_10.42.42.2(pid=6350): stderr: | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040316607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040316627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040316643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040316643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040316643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:19.827616 run osmo-msc_10.42.42.6(pid=6356): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6356)] 04:03:19.877729 run osmo-msc_10.42.42.6(pid=6356): stdout: | (launched: 2022-12-14_04:03:18.674405) 04:03:19.930196 run osmo-msc_10.42.42.6(pid=6356): stderr: | [0;m[38;5;43m20221214040318993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040318994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7828615c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040318994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040318994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040318994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040318994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040318996 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040318996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040318996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040318996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:19.982706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6349): Terminating (SIGTERM) 04:03:20.024773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6352): Terminating (SIGTERM) 04:03:20.066568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6355): Terminating (SIGTERM) 04:03:20.109258 --- ParallelTerminationStrategy: PID 6349 died... 04:03:20.129405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6349): Terminated: ok {rc=0} 04:03:20.175670 --- ParallelTerminationStrategy: PID 6352 died... 04:03:20.195427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6352): Terminated: ok {rc=0} 04:03:20.241599 --- ParallelTerminationStrategy: PID 6355 died... 04:03:20.261516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6355): Terminated: ok {rc=0} 04:03:20.350346 bus /sierra_3: Setting Powered False 04:03:21.448078 bus /sierra_3: Setting Powered False 04:03:22.565651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:03:23.710184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:23.722376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:03:23.792355 tst mo_mt_call_osmux.py: using LAC 38414 04:03:23.913687 tst mo_mt_call_osmux.py: using RAC 164 04:03:24.033268 tst mo_mt_call_osmux.py: using CellId 38414 04:03:24.161636 tst mo_mt_call_osmux.py: using BVCI 38415 04:03:24.272064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:24.283493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:24.294792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:24.305811 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:24.317083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:03:24.328563 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:24.444770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:03:24.560855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:25.034315 run create_hlr_db(pid=6358): Launched 04:03:25.160468 bus /sierra_2: Setting Powered False 04:03:26.220883 run create_hlr_db(pid=6358): Terminated: ok {rc=0} 04:03:26.663409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Launched 04:03:26.991462 run osmo-hlr_10.42.42.2(pid=6361): Launched 04:03:27.115108 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:27.678190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Launched 04:03:28.004437 run osmo-stp_10.42.42.5(pid=6364): Launched 04:03:28.130073 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:28.716813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6366): Launched 04:03:29.042732 run osmo-msc_10.42.42.6(pid=6367): Launched 04:03:29.224002 run osmo-stp_10.42.42.5(pid=6364): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] 04:03:29.360924 run osmo-stp_10.42.42.5(pid=6364): stdout: | (launched: 2022-12-14_04:03:27.944386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:29.497948 run osmo-stp_10.42.42.5(pid=6364): stderr: | [0;m[38;5;43m20221214040328137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040328137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040328138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040328138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:29.634419 run osmo-stp_10.42.42.5(pid=6364): stdout: | (launched: 2022-12-14_04:03:27.944386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:29.763207 run osmo-stp_10.42.42.5(pid=6364): stderr: | [0;m[38;5;43m20221214040328137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040328137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040328138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040328138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040328139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:29.917384 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6364): Process ended prematurely: osmo-stp_10.42.42.5(pid=6364) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:03:29.927446 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:03:29.955160 run osmo-hlr_10.42.42.2(pid=6361): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6361)] 04:03:30.005555 run osmo-hlr_10.42.42.2(pid=6361): stdout: | (launched: 2022-12-14_04:03:26.931129) 04:03:30.057238 run osmo-hlr_10.42.42.2(pid=6361): stderr: | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040327130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040327143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040327151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040327151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040327151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:30.129475 run osmo-msc_10.42.42.6(pid=6367): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6367)] 04:03:30.179048 run osmo-msc_10.42.42.6(pid=6367): stdout: | (launched: 2022-12-14_04:03:28.983027) 04:03:30.230663 run osmo-msc_10.42.42.6(pid=6367): stderr: | [0;m[38;5;43m20221214040329302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040329302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5052dd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040329303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040329303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040329303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040329303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040329305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040329305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040329305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040329305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:30.282705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Terminating (SIGTERM) 04:03:30.324582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Terminating (SIGTERM) 04:03:30.366104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6366): Terminating (SIGTERM) 04:03:30.407901 --- ParallelTerminationStrategy: PID 6360 died... 04:03:30.428082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6360): Terminated: ok {rc=0} 04:03:30.474189 --- ParallelTerminationStrategy: PID 6363 died... 04:03:30.493813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6363): Terminated: ok {rc=0} 04:03:30.539871 --- ParallelTerminationStrategy: PID 6366 died... 04:03:30.559513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6366): Terminated: ok {rc=0} 04:03:30.648018 bus /sierra_3: Setting Powered False 04:03:31.769317 bus /sierra_3: Setting Powered False 04:03:32.895586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:03:34.152677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:34.159808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:03:34.194004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:03:34.222055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:03:34.275664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:03:34.310611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:03:34.338427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:03:34.890407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:03:34.943444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:34.955157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:03:35.030497 tst mo_mt_call.py: using LAC 38415 04:03:35.157362 tst mo_mt_call.py: using RAC 165 04:03:35.282389 tst mo_mt_call.py: using CellId 38415 04:03:35.410059 tst mo_mt_call.py: using BVCI 38416 04:03:35.527982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:35.539690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:35.551218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:35.562778 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:35.574769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:35.586555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:35.704292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:35.823140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:36.326248 run create_hlr_db(pid=6373): Launched 04:03:36.452257 bus /sierra_2: Setting Powered False 04:03:37.516629 run create_hlr_db(pid=6373): Terminated: ok {rc=0} 04:03:37.969475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6375): Launched 04:03:38.298086 run osmo-hlr_10.42.42.2(pid=6376): Launched 04:03:38.424876 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:38.988000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6378): Launched 04:03:39.315347 run osmo-stp_10.42.42.5(pid=6379): Launched 04:03:39.441212 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:40.032825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6381): Launched 04:03:40.339445 run osmo-msc_10.42.42.6(pid=6382): Launched 04:03:40.512024 run osmo-stp_10.42.42.5(pid=6379): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6379)] 04:03:40.642700 run osmo-stp_10.42.42.5(pid=6379): stdout: | (launched: 2022-12-14_04:03:39.255417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:40.771777 run osmo-stp_10.42.42.5(pid=6379): stderr: | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040339449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:40.899241 run osmo-stp_10.42.42.5(pid=6379): stdout: | (launched: 2022-12-14_04:03:39.255417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:41.020156 run osmo-stp_10.42.42.5(pid=6379): stderr: | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040339448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040339449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040339449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:41.165573 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6379): Process ended prematurely: osmo-stp_10.42.42.5(pid=6379) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6379)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:03:41.174561 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:03:41.200937 run osmo-hlr_10.42.42.2(pid=6376): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6376)] 04:03:41.249099 run osmo-hlr_10.42.42.2(pid=6376): stdout: | (launched: 2022-12-14_04:03:38.237878) 04:03:41.298167 run osmo-hlr_10.42.42.2(pid=6376): stderr: | [0;m[1;31m20221214040338436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040338436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040338436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040338436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040338436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040338437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040338448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040338456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040338457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040338457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:41.366818 run osmo-msc_10.42.42.6(pid=6382): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6382)] 04:03:41.414288 run osmo-msc_10.42.42.6(pid=6382): stdout: | (launched: 2022-12-14_04:03:40.282783) 04:03:41.463436 run osmo-msc_10.42.42.6(pid=6382): stderr: | [0;m[38;5;43m20221214040340553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040340553 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d973afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040340553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040340553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040340553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040340554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040340555 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040340556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040340556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040340556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:41.513025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6375): Terminating (SIGTERM) 04:03:41.552570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6378): Terminating (SIGTERM) 04:03:41.592034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6381): Terminating (SIGTERM) 04:03:41.631683 --- ParallelTerminationStrategy: PID 6375 died... 04:03:41.650748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6375): Terminated: ok {rc=0} 04:03:41.694374 --- ParallelTerminationStrategy: PID 6378 died... 04:03:41.713292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6378): Terminated: ok {rc=0} 04:03:41.756835 --- ParallelTerminationStrategy: PID 6381 died... 04:03:41.775891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6381): Terminated: ok {rc=0} 04:03:41.859466 bus /sierra_3: Setting Powered False 04:03:42.958516 bus /sierra_3: Setting Powered False 04:03:44.076145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:03:45.225394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.238475 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:03:45.310853 tst mo_mt_call_osmux.py: using LAC 38416 04:03:45.440032 tst mo_mt_call_osmux.py: using RAC 166 04:03:45.567158 tst mo_mt_call_osmux.py: using CellId 38416 04:03:45.694324 tst mo_mt_call_osmux.py: using BVCI 38417 04:03:45.812604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.824567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.840686 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.853097 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.866287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:03:45.881791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:46.028754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:03:46.150589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:46.661712 run create_hlr_db(pid=6384): Launched 04:03:46.820020 bus /sierra_2: Setting Powered False 04:03:47.883528 run create_hlr_db(pid=6384): Terminated: ok {rc=0} 04:03:48.318064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6386): Launched 04:03:48.623067 run osmo-hlr_10.42.42.2(pid=6387): Launched 04:03:48.740564 run osmo-stp_10.42.42.5: Starting osmo-stp 04:03:49.284075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6389): Launched 04:03:49.588130 run osmo-stp_10.42.42.5(pid=6390): Launched 04:03:49.704286 run osmo-msc_10.42.42.6: Starting osmo-msc 04:03:50.259144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6392): Launched 04:03:50.563429 run osmo-msc_10.42.42.6(pid=6393): Launched 04:03:50.734718 run osmo-stp_10.42.42.5(pid=6390): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6390)] 04:03:50.863079 run osmo-stp_10.42.42.5(pid=6390): stdout: | (launched: 2022-12-14_04:03:49.531581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:50.991527 run osmo-stp_10.42.42.5(pid=6390): stderr: | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040349704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:51.117997 run osmo-stp_10.42.42.5(pid=6390): stdout: | (launched: 2022-12-14_04:03:49.531581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:03:51.238313 run osmo-stp_10.42.42.5(pid=6390): stderr: | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040349703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040349704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040349704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:03:51.382439 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6390): Process ended prematurely: osmo-stp_10.42.42.5(pid=6390) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6390)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:03:51.391444 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:03:51.417417 run osmo-hlr_10.42.42.2(pid=6387): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6387)] 04:03:51.465475 run osmo-hlr_10.42.42.2(pid=6387): stdout: | (launched: 2022-12-14_04:03:48.566736) 04:03:51.514437 run osmo-hlr_10.42.42.2(pid=6387): stderr: | [0;m[1;31m20221214040348744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040348744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040348745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040348745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040348745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040348745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040348757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040348767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040348767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040348767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:03:51.583038 run osmo-msc_10.42.42.6(pid=6393): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6393)] 04:03:51.630199 run osmo-msc_10.42.42.6(pid=6393): stdout: | (launched: 2022-12-14_04:03:50.506837) 04:03:51.679026 run osmo-msc_10.42.42.6(pid=6393): stderr: | [0;m[38;5;43m20221214040350779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040350779 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7ae8e59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040350779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040350779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040350780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040350780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040350782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040350782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040350782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040350782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:03:51.728225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6386): Terminating (SIGTERM) 04:03:51.767550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6389): Terminating (SIGTERM) 04:03:51.807686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6392): Terminating (SIGTERM) 04:03:51.847409 --- ParallelTerminationStrategy: PID 6386 died... 04:03:51.866447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6386): Terminated: ok {rc=0} 04:03:51.910313 --- ParallelTerminationStrategy: PID 6389 died... 04:03:51.928605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6389): Terminated: ok {rc=0} 04:03:51.971986 --- ParallelTerminationStrategy: PID 6392 died... 04:03:51.990449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6392): Terminated: ok {rc=0} 04:03:52.075784 bus /sierra_3: Setting Powered False 04:03:53.174894 bus /sierra_3: Setting Powered False 04:03:54.290411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:03:55.542293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:03:55.548742 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:03:55.581952 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:03:55.608645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:03:55.660786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:03:55.695897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:03:55.724792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:03:56.271743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:03:56.320818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.332271 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:03:56.406328 tst mo_mt_call.py: using LAC 38417 04:03:56.535868 tst mo_mt_call.py: using RAC 167 04:03:56.662156 tst mo_mt_call.py: using CellId 38417 04:03:56.790331 tst mo_mt_call.py: using BVCI 38418 04:03:56.909363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.921308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.933351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.945038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.957924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:03:56.970611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:57.090552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:03:57.211794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:03:57.715511 run create_hlr_db(pid=6398): Launched 04:03:57.839977 bus /sierra_2: Setting Powered False 04:03:58.904511 run create_hlr_db(pid=6398): Terminated: ok {rc=0} 04:03:59.339202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Launched 04:03:59.643527 run osmo-hlr_10.42.42.2(pid=6401): Launched 04:03:59.759871 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:00.285117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Launched 04:04:00.590273 run osmo-stp_10.42.42.5(pid=6404): Launched 04:04:00.706556 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:01.320233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Launched 04:04:01.667667 run osmo-msc_10.42.42.6(pid=6407): Launched 04:04:01.910237 run osmo-stp_10.42.42.5(pid=6404): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] 04:04:02.162539 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-14_04:04:00.533624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:02.396117 run osmo-stp_10.42.42.5(pid=6404): stderr: | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040400706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:02.523191 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-14_04:04:00.533624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:02.643744 run osmo-stp_10.42.42.5(pid=6404): stderr: | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040400705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040400706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040400706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:02.788003 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:04:02.797015 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:04:02.823491 run osmo-hlr_10.42.42.2(pid=6401): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6401)] 04:04:02.871408 run osmo-hlr_10.42.42.2(pid=6401): stdout: | (launched: 2022-12-14_04:03:59.587328) 04:04:02.920773 run osmo-hlr_10.42.42.2(pid=6401): stderr: | [0;m[1;31m20221214040359762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040359762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040359763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040359763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040359763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040359763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040359775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040359783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040359784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040359784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:02.989975 run osmo-msc_10.42.42.6(pid=6407): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6407)] 04:04:03.037803 run osmo-msc_10.42.42.6(pid=6407): stdout: | (launched: 2022-12-14_04:04:01.609697) 04:04:03.087224 run osmo-msc_10.42.42.6(pid=6407): stderr: | [0;m[38;5;43m20221214040402217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040402217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8669c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040402218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040402218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040402218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040402218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040402220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040402220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040402220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040402220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:03.137098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminating (SIGTERM) 04:04:03.177090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminating (SIGTERM) 04:04:03.217055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Terminating (SIGTERM) 04:04:03.257256 --- ParallelTerminationStrategy: PID 6400 died... 04:04:03.276317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminated: ok {rc=0} 04:04:03.320536 --- ParallelTerminationStrategy: PID 6403 died... 04:04:03.339230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminated: ok {rc=0} 04:04:03.383096 --- ParallelTerminationStrategy: PID 6406 died... 04:04:03.401773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Terminated: ok {rc=0} 04:04:03.485231 bus /sierra_3: Setting Powered False 04:04:04.585590 bus /sierra_3: Setting Powered False 04:04:05.702829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:04:06.846022 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:06.858005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:04:06.928816 tst mo_mt_call_osmux.py: using LAC 38418 04:04:07.047891 tst mo_mt_call_osmux.py: using RAC 168 04:04:07.168531 tst mo_mt_call_osmux.py: using CellId 38418 04:04:07.288641 tst mo_mt_call_osmux.py: using BVCI 38419 04:04:07.399781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:07.411143 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:07.422326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:07.433473 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:07.444675 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:04:07.455838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:07.571274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:04:07.693558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:08.201037 run create_hlr_db(pid=6409): Launched 04:04:08.325955 bus /sierra_2: Setting Powered False 04:04:09.389536 run create_hlr_db(pid=6409): Terminated: ok {rc=0} 04:04:09.825618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6411): Launched 04:04:10.133936 run osmo-hlr_10.42.42.2(pid=6412): Launched 04:04:10.251304 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:10.793680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6414): Launched 04:04:11.098729 run osmo-stp_10.42.42.5(pid=6415): Launched 04:04:11.214244 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:11.765231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6417): Launched 04:04:12.071110 run osmo-msc_10.42.42.6(pid=6418): Launched 04:04:12.244056 run osmo-stp_10.42.42.5(pid=6415): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6415)] 04:04:12.373776 run osmo-stp_10.42.42.5(pid=6415): stdout: | (launched: 2022-12-14_04:04:11.042063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:12.502886 run osmo-stp_10.42.42.5(pid=6415): stderr: | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040411213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:12.629310 run osmo-stp_10.42.42.5(pid=6415): stdout: | (launched: 2022-12-14_04:04:11.042063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:12.750187 run osmo-stp_10.42.42.5(pid=6415): stderr: | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040411212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040411213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040411213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:12.894391 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6415): Process ended prematurely: osmo-stp_10.42.42.5(pid=6415) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6415)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:04:12.903304 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:04:12.929580 run osmo-hlr_10.42.42.2(pid=6412): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6412)] 04:04:12.977151 run osmo-hlr_10.42.42.2(pid=6412): stdout: | (launched: 2022-12-14_04:04:10.076816) 04:04:13.026248 run osmo-hlr_10.42.42.2(pid=6412): stderr: | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040410254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040410266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040410274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040410274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040410275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:13.095035 run osmo-msc_10.42.42.6(pid=6418): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6418)] 04:04:13.142378 run osmo-msc_10.42.42.6(pid=6418): stdout: | (launched: 2022-12-14_04:04:12.014286) 04:04:13.191351 run osmo-msc_10.42.42.6(pid=6418): stderr: | [0;m[38;5;43m20221214040412284 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040412285 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78ea916c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040412285 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040412285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040412285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040412285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040412287 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040412287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040412287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040412287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:13.241321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6411): Terminating (SIGTERM) 04:04:13.280676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6414): Terminating (SIGTERM) 04:04:13.319988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6417): Terminating (SIGTERM) 04:04:13.359544 --- ParallelTerminationStrategy: PID 6411 died... 04:04:13.378601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6411): Terminated: ok {rc=0} 04:04:13.422315 --- ParallelTerminationStrategy: PID 6414 died... 04:04:13.440834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6414): Terminated: ok {rc=0} 04:04:13.484371 --- ParallelTerminationStrategy: PID 6417 died... 04:04:13.503024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6417): Terminated: ok {rc=0} 04:04:13.588497 bus /sierra_3: Setting Powered False 04:04:14.689915 bus /sierra_3: Setting Powered False 04:04:15.806787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:04:17.073014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:17.079971 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:04:17.114621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:04:17.141937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:04:17.194395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:04:17.229153 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:04:17.256893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:04:17.809795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:04:17.858090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:17.869518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:04:17.939410 tst mo_mt_call.py: using LAC 38419 04:04:18.060061 tst mo_mt_call.py: using RAC 169 04:04:18.179694 tst mo_mt_call.py: using CellId 38419 04:04:18.298781 tst mo_mt_call.py: using BVCI 38420 04:04:18.410226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:18.421453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:18.432426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:18.443446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:18.454585 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:18.465707 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:18.585900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:18.706097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:19.213336 run create_hlr_db(pid=6423): Launched 04:04:19.339721 bus /sierra_2: Setting Powered False 04:04:20.403457 run create_hlr_db(pid=6423): Terminated: ok {rc=0} 04:04:20.838768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6425): Launched 04:04:21.146573 run osmo-hlr_10.42.42.2(pid=6426): Launched 04:04:21.263524 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:21.788494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6428): Launched 04:04:22.094490 run osmo-stp_10.42.42.5(pid=6429): Launched 04:04:22.210637 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:22.763750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6431): Launched 04:04:23.069168 run osmo-msc_10.42.42.6(pid=6432): Launched 04:04:23.239937 run osmo-stp_10.42.42.5(pid=6429): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6429)] 04:04:23.368434 run osmo-stp_10.42.42.5(pid=6429): stdout: | (launched: 2022-12-14_04:04:22.037603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:23.497261 run osmo-stp_10.42.42.5(pid=6429): stderr: | [0;m[38;5;43m20221214040422207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040422207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040422208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040422208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:23.624142 run osmo-stp_10.42.42.5(pid=6429): stdout: | (launched: 2022-12-14_04:04:22.037603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:23.744840 run osmo-stp_10.42.42.5(pid=6429): stderr: | [0;m[38;5;43m20221214040422207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040422207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040422208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040422208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040422209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:23.889368 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6429): Process ended prematurely: osmo-stp_10.42.42.5(pid=6429) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6429)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:04:23.898281 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:04:23.924687 run osmo-hlr_10.42.42.2(pid=6426): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6426)] 04:04:23.972520 run osmo-hlr_10.42.42.2(pid=6426): stdout: | (launched: 2022-12-14_04:04:21.090136) 04:04:24.021730 run osmo-hlr_10.42.42.2(pid=6426): stderr: | [0;m[1;31m20221214040421266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040421266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040421266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040421266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040421267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040421267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040421278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040421286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040421287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040421287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:24.091286 run osmo-msc_10.42.42.6(pid=6432): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6432)] 04:04:24.138658 run osmo-msc_10.42.42.6(pid=6432): stdout: | (launched: 2022-12-14_04:04:23.012457) 04:04:24.187577 run osmo-msc_10.42.42.6(pid=6432): stderr: | [0;m[38;5;43m20221214040423283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040423283 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2f81f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040423283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040423283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040423283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040423283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040423285 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040423285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040423286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040423286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:24.236838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6425): Terminating (SIGTERM) 04:04:24.276203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6428): Terminating (SIGTERM) 04:04:24.315624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6431): Terminating (SIGTERM) 04:04:24.355330 --- ParallelTerminationStrategy: PID 6425 died... 04:04:24.374379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6425): Terminated: ok {rc=0} 04:04:24.417989 --- ParallelTerminationStrategy: PID 6428 died... 04:04:24.436509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6428): Terminated: ok {rc=0} 04:04:24.479931 --- ParallelTerminationStrategy: PID 6431 died... 04:04:24.498385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6431): Terminated: ok {rc=0} 04:04:24.583824 bus /sierra_3: Setting Powered False 04:04:25.683843 bus /sierra_3: Setting Powered False 04:04:26.796415 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:04:27.946126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:27.959034 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:04:28.034605 tst mo_mt_call_osmux.py: using LAC 38420 04:04:28.161975 tst mo_mt_call_osmux.py: using RAC 170 04:04:28.287847 tst mo_mt_call_osmux.py: using CellId 38420 04:04:28.414561 tst mo_mt_call_osmux.py: using BVCI 38421 04:04:28.534552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:28.546557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:28.558441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:28.570056 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:28.582256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:04:28.594326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:28.714583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:04:28.832264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:29.304906 run create_hlr_db(pid=6434): Launched 04:04:29.429226 bus /sierra_2: Setting Powered False 04:04:30.489687 run create_hlr_db(pid=6434): Terminated: ok {rc=0} 04:04:30.924877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6436): Launched 04:04:31.248175 run osmo-hlr_10.42.42.2(pid=6437): Launched 04:04:31.392064 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:32.201132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6439): Launched 04:04:32.522680 run osmo-stp_10.42.42.5(pid=6440): Launched 04:04:32.641453 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:33.209751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6442): Launched 04:04:33.515511 run osmo-msc_10.42.42.6(pid=6443): Launched 04:04:33.686380 run osmo-stp_10.42.42.5(pid=6440): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6440)] 04:04:33.814531 run osmo-stp_10.42.42.5(pid=6440): stdout: | (launched: 2022-12-14_04:04:32.465661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:33.942871 run osmo-stp_10.42.42.5(pid=6440): stderr: | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040432640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:34.069324 run osmo-stp_10.42.42.5(pid=6440): stdout: | (launched: 2022-12-14_04:04:32.465661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:34.190497 run osmo-stp_10.42.42.5(pid=6440): stderr: | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040432640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040432640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040432641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:34.334992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6440): Process ended prematurely: osmo-stp_10.42.42.5(pid=6440) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6440)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:04:34.344070 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:04:34.370393 run osmo-hlr_10.42.42.2(pid=6437): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6437)] 04:04:34.417893 run osmo-hlr_10.42.42.2(pid=6437): stdout: | (launched: 2022-12-14_04:04:31.190059) 04:04:34.466940 run osmo-hlr_10.42.42.2(pid=6437): stderr: | [0;m[1;31m20221214040431527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040431527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040431527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040431528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040431528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040431528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040431558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040431582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040431582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040431583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:34.535581 run osmo-msc_10.42.42.6(pid=6443): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6443)] 04:04:34.582805 run osmo-msc_10.42.42.6(pid=6443): stdout: | (launched: 2022-12-14_04:04:33.458734) 04:04:34.631551 run osmo-msc_10.42.42.6(pid=6443): stderr: | [0;m[38;5;43m20221214040433732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040433732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7febc975ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040433732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040433732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040433732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040433732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040433734 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040433734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040433735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040433735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:34.680658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6436): Terminating (SIGTERM) 04:04:34.719688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6439): Terminating (SIGTERM) 04:04:34.758667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6442): Terminating (SIGTERM) 04:04:34.797960 --- ParallelTerminationStrategy: PID 6436 died... 04:04:34.817045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6436): Terminated: ok {rc=0} 04:04:34.860559 --- ParallelTerminationStrategy: PID 6439 died... 04:04:34.879117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6439): Terminated: ok {rc=0} 04:04:34.922412 --- ParallelTerminationStrategy: PID 6442 died... 04:04:34.940867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6442): Terminated: ok {rc=0} 04:04:35.026568 bus /sierra_3: Setting Powered False 04:04:36.125203 bus /sierra_3: Setting Powered False 04:04:37.240665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:04:38.498481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:04:38.505631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:04:38.540391 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:04:38.567989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:04:38.621988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:04:38.657103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:04:38.684654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:04:39.236092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:04:39.288291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.300148 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:04:39.373675 tst mo_mt_call.py: using LAC 38421 04:04:39.491831 tst mo_mt_call.py: using RAC 171 04:04:39.612327 tst mo_mt_call.py: using CellId 38421 04:04:39.730618 tst mo_mt_call.py: using BVCI 38422 04:04:39.841765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.853126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.864199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.875194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.886303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:39.897302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:40.016862 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:40.134474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:40.606394 run create_hlr_db(pid=6448): Launched 04:04:40.733554 bus /sierra_2: Setting Powered False 04:04:41.794081 run create_hlr_db(pid=6448): Terminated: ok {rc=0} 04:04:42.239469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6450): Launched 04:04:42.566538 run osmo-hlr_10.42.42.2(pid=6451): Launched 04:04:42.692798 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:43.253298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6453): Launched 04:04:43.578960 run osmo-stp_10.42.42.5(pid=6454): Launched 04:04:43.703521 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:44.291761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6456): Launched 04:04:44.617620 run osmo-msc_10.42.42.6(pid=6457): Launched 04:04:44.801556 run osmo-stp_10.42.42.5(pid=6454): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6454)] 04:04:44.939540 run osmo-stp_10.42.42.5(pid=6454): stdout: | (launched: 2022-12-14_04:04:43.518922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:45.079198 run osmo-stp_10.42.42.5(pid=6454): stderr: | [0;m[38;5;43m20221214040443712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040443712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040443713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040443713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:45.216605 run osmo-stp_10.42.42.5(pid=6454): stdout: | (launched: 2022-12-14_04:04:43.518922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:45.346511 run osmo-stp_10.42.42.5(pid=6454): stderr: | [0;m[38;5;43m20221214040443712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040443712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040443713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040443713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040443714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:45.501878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6454): Process ended prematurely: osmo-stp_10.42.42.5(pid=6454) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6454)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:04:45.511687 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:04:45.539685 run osmo-hlr_10.42.42.2(pid=6451): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6451)] 04:04:45.590521 run osmo-hlr_10.42.42.2(pid=6451): stdout: | (launched: 2022-12-14_04:04:42.506556) 04:04:45.642883 run osmo-hlr_10.42.42.2(pid=6451): stderr: | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040442705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040442730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040442739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040442739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040442740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:45.715619 run osmo-msc_10.42.42.6(pid=6457): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6457)] 04:04:45.765568 run osmo-msc_10.42.42.6(pid=6457): stdout: | (launched: 2022-12-14_04:04:44.557442) 04:04:45.817738 run osmo-msc_10.42.42.6(pid=6457): stderr: | [0;m[38;5;43m20221214040444880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040444880 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48416acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040444880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040444880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040444881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040444881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040444883 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040444883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040444883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040444883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:45.885169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6450): Terminating (SIGTERM) 04:04:45.927516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6453): Terminating (SIGTERM) 04:04:45.971697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6456): Terminating (SIGTERM) 04:04:46.016061 --- ParallelTerminationStrategy: PID 6450 died... 04:04:46.036744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6450): Terminated: ok {rc=0} 04:04:46.084024 --- ParallelTerminationStrategy: PID 6453 died... 04:04:46.104525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6453): Terminated: ok {rc=0} 04:04:46.150755 --- ParallelTerminationStrategy: PID 6456 died... 04:04:46.171364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6456): Terminated: ok {rc=0} 04:04:46.273247 bus /sierra_3: Setting Powered False 04:04:47.388070 bus /sierra_3: Setting Powered False 04:04:48.505503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:04:49.654655 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:49.667120 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:04:49.740056 tst mo_mt_call_osmux.py: using LAC 38422 04:04:49.860677 tst mo_mt_call_osmux.py: using RAC 172 04:04:49.981408 tst mo_mt_call_osmux.py: using CellId 38422 04:04:50.100590 tst mo_mt_call_osmux.py: using BVCI 38423 04:04:50.210944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:50.222415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:50.233654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:50.244661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:50.256201 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:04:50.267366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:50.387460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:04:50.505176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:04:50.978358 run create_hlr_db(pid=6459): Launched 04:04:51.103346 bus /sierra_2: Setting Powered False 04:04:52.163925 run create_hlr_db(pid=6459): Terminated: ok {rc=0} 04:04:52.611759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6461): Launched 04:04:52.941626 run osmo-hlr_10.42.42.2(pid=6462): Launched 04:04:53.069647 run osmo-stp_10.42.42.5: Starting osmo-stp 04:04:53.632272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6464): Launched 04:04:53.959923 run osmo-stp_10.42.42.5(pid=6465): Launched 04:04:54.086531 run osmo-msc_10.42.42.6: Starting osmo-msc 04:04:54.675878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6467): Launched 04:04:55.003433 run osmo-msc_10.42.42.6(pid=6468): Launched 04:04:55.187079 run osmo-stp_10.42.42.5(pid=6465): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6465)] 04:04:55.324404 run osmo-stp_10.42.42.5(pid=6465): stdout: | (launched: 2022-12-14_04:04:53.899763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:55.462454 run osmo-stp_10.42.42.5(pid=6465): stderr: | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040454094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:55.599739 run osmo-stp_10.42.42.5(pid=6465): stdout: | (launched: 2022-12-14_04:04:53.899763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:04:55.729535 run osmo-stp_10.42.42.5(pid=6465): stderr: | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040454093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040454094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040454094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:04:55.884549 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6465): Process ended prematurely: osmo-stp_10.42.42.5(pid=6465) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6465)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:04:55.894503 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:04:55.922323 run osmo-hlr_10.42.42.2(pid=6462): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6462)] 04:04:55.973590 run osmo-hlr_10.42.42.2(pid=6462): stdout: | (launched: 2022-12-14_04:04:52.881409) 04:04:56.025862 run osmo-hlr_10.42.42.2(pid=6462): stderr: | [0;m[1;31m20221214040453080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040453080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040453080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040453080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040453081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040453081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040453093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040453103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040453104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040453104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:04:56.098628 run osmo-msc_10.42.42.6(pid=6468): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6468)] 04:04:56.148539 run osmo-msc_10.42.42.6(pid=6468): stdout: | (launched: 2022-12-14_04:04:54.943042) 04:04:56.200611 run osmo-msc_10.42.42.6(pid=6468): stderr: | [0;m[38;5;43m20221214040455266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040455266 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a438aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040455266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040455266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040455266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040455267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040455268 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040455269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040455269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040455269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:04:56.253237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6461): Terminating (SIGTERM) 04:04:56.294876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6464): Terminating (SIGTERM) 04:04:56.337170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6467): Terminating (SIGTERM) 04:04:56.379515 --- ParallelTerminationStrategy: PID 6461 died... 04:04:56.399849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6461): Terminated: ok {rc=0} 04:04:56.446995 --- ParallelTerminationStrategy: PID 6464 died... 04:04:56.466872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6464): Terminated: ok {rc=0} 04:04:56.513231 --- ParallelTerminationStrategy: PID 6467 died... 04:04:56.533140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6467): Terminated: ok {rc=0} 04:04:56.622618 bus /sierra_3: Setting Powered False 04:04:57.722619 bus /sierra_3: Setting Powered False 04:04:58.839245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:05:00.100150 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:00.106657 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:05:00.139956 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:05:00.167344 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:05:00.218488 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:05:00.252790 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:05:00.280086 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:05:00.841602 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:05:00.905696 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:00.918844 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:05:00.993445 tst mo_mt_call.py: using LAC 38423 04:05:01.122376 tst mo_mt_call.py: using RAC 173 04:05:01.244397 tst mo_mt_call.py: using CellId 38423 04:05:01.383617 tst mo_mt_call.py: using BVCI 38424 04:05:01.538541 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:01.550822 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:01.564382 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:01.576475 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:01.588851 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:01.600872 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:01.727227 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:01.874414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:02.372105 run create_hlr_db(pid=6476): Launched 04:05:02.498331 bus /sierra_2: Setting Powered False 04:05:03.559189 run create_hlr_db(pid=6476): Terminated: ok {rc=0} 04:05:03.984897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Launched 04:05:04.289626 run osmo-hlr_10.42.42.2(pid=6479): Launched 04:05:04.406189 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:04.930816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Launched 04:05:05.235409 run osmo-stp_10.42.42.5(pid=6482): Launched 04:05:05.353177 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:05.906093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Launched 04:05:06.211342 run osmo-msc_10.42.42.6(pid=6485): Launched 04:05:06.382614 run osmo-stp_10.42.42.5(pid=6482): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] 04:05:06.511386 run osmo-stp_10.42.42.5(pid=6482): stdout: | (launched: 2022-12-14_04:05:05.178815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:06.640393 run osmo-stp_10.42.42.5(pid=6482): stderr: | [0;m[38;5;43m20221214040505350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040505351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040505351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040505351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:06.767293 run osmo-stp_10.42.42.5(pid=6482): stdout: | (launched: 2022-12-14_04:05:05.178815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:06.887942 run osmo-stp_10.42.42.5(pid=6482): stderr: | [0;m[38;5;43m20221214040505350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040505351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040505351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040505351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:07.032463 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6482): Process ended prematurely: osmo-stp_10.42.42.5(pid=6482) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:05:07.041484 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:05:07.067539 run osmo-hlr_10.42.42.2(pid=6479): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6479)] 04:05:07.115072 run osmo-hlr_10.42.42.2(pid=6479): stdout: | (launched: 2022-12-14_04:05:04.233217) 04:05:07.164035 run osmo-hlr_10.42.42.2(pid=6479): stderr: | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040504410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040504423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040504433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040504434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040504434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:07.232565 run osmo-msc_10.42.42.6(pid=6485): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6485)] 04:05:07.280040 run osmo-msc_10.42.42.6(pid=6485): stdout: | (launched: 2022-12-14_04:05:06.154814) 04:05:07.328882 run osmo-msc_10.42.42.6(pid=6485): stderr: | [0;m[38;5;43m20221214040506426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040506427 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7017f98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040506427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040506427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040506427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040506427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040506429 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040506429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040506429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040506430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:07.378198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Terminating (SIGTERM) 04:05:07.417444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Terminating (SIGTERM) 04:05:07.456808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Terminating (SIGTERM) 04:05:07.496360 --- ParallelTerminationStrategy: PID 6478 died... 04:05:07.515326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Terminated: ok {rc=0} 04:05:07.559195 --- ParallelTerminationStrategy: PID 6481 died... 04:05:07.577705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Terminated: ok {rc=0} 04:05:07.621314 --- ParallelTerminationStrategy: PID 6484 died... 04:05:07.639851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Terminated: ok {rc=0} 04:05:07.725864 bus /sierra_3: Setting Powered False 04:05:08.826007 bus /sierra_3: Setting Powered False 04:05:09.940080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:05:11.089652 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.102151 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:05:11.175411 tst mo_mt_call_osmux.py: using LAC 38424 04:05:11.305090 tst mo_mt_call_osmux.py: using RAC 174 04:05:11.432539 tst mo_mt_call_osmux.py: using CellId 38424 04:05:11.561357 tst mo_mt_call_osmux.py: using BVCI 38425 04:05:11.681342 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.693195 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.704721 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.716357 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.728371 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:05:11.740283 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:11.860454 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:05:11.978810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:12.452336 run create_hlr_db(pid=6487): Launched 04:05:12.577451 bus /sierra_2: Setting Powered False 04:05:13.638632 run create_hlr_db(pid=6487): Terminated: ok {rc=0} 04:05:14.082981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Launched 04:05:14.410147 run osmo-hlr_10.42.42.2(pid=6490): Launched 04:05:14.535882 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:15.103729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Launched 04:05:15.430491 run osmo-stp_10.42.42.5(pid=6493): Launched 04:05:15.555066 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:16.164911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Launched 04:05:16.499043 run osmo-msc_10.42.42.6(pid=6496): Launched 04:05:17.026536 run osmo-stp_10.42.42.5(pid=6493): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] 04:05:17.231701 run osmo-stp_10.42.42.5(pid=6493): stdout: | (launched: 2022-12-14_04:05:15.369899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:17.366151 run osmo-stp_10.42.42.5(pid=6493): stderr: | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040515564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:17.493950 run osmo-stp_10.42.42.5(pid=6493): stdout: | (launched: 2022-12-14_04:05:15.369899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:17.614736 run osmo-stp_10.42.42.5(pid=6493): stderr: | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040515563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040515564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040515564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:17.759626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6493): Process ended prematurely: osmo-stp_10.42.42.5(pid=6493) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:05:17.768563 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 04:05:17.794843 run osmo-hlr_10.42.42.2(pid=6490): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6490)] 04:05:17.842606 run osmo-hlr_10.42.42.2(pid=6490): stdout: | (launched: 2022-12-14_04:05:14.350098) 04:05:17.891911 run osmo-hlr_10.42.42.2(pid=6490): stderr: | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040514549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040514561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040514569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040514569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040514569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:17.960809 run osmo-msc_10.42.42.6(pid=6496): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6496)] 04:05:18.008583 run osmo-msc_10.42.42.6(pid=6496): stdout: | (launched: 2022-12-14_04:05:16.437934) 04:05:18.057645 run osmo-msc_10.42.42.6(pid=6496): stderr: | [0;m[38;5;43m20221214040516826 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040516826 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f634eeeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040516827 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040516827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040516827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040516828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040516833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040516833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040516834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040516835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:18.107326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Terminating (SIGTERM) 04:05:18.146667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Terminating (SIGTERM) 04:05:18.185983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Terminating (SIGTERM) 04:05:18.226003 --- ParallelTerminationStrategy: PID 6489 died... 04:05:18.245041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6489): Terminated: ok {rc=0} 04:05:18.289308 --- ParallelTerminationStrategy: PID 6492 died... 04:05:18.307634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6492): Terminated: ok {rc=0} 04:05:18.351221 --- ParallelTerminationStrategy: PID 6495 died... 04:05:18.369873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6495): Terminated: ok {rc=0} 04:05:18.455454 bus /sierra_3: Setting Powered False 04:05:19.554661 bus /sierra_3: Setting Powered False 04:05:20.670748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:05:21.923599 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:21.929647 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:05:21.963205 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:05:21.990120 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:05:22.041119 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:05:22.074353 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:05:22.101443 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:05:22.652693 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:05:22.702731 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:22.714083 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:05:22.789525 tst mo_mt_call.py: using LAC 38425 04:05:22.909145 tst mo_mt_call.py: using RAC 175 04:05:23.027111 tst mo_mt_call.py: using CellId 38425 04:05:23.146303 tst mo_mt_call.py: using BVCI 38426 04:05:23.257941 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:23.269182 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:23.280238 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:23.291343 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:23.302691 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:23.313939 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:23.431306 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:23.549069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:24.020886 run create_hlr_db(pid=6501): Launched 04:05:24.145960 bus /sierra_2: Setting Powered False 04:05:25.206597 run create_hlr_db(pid=6501): Terminated: ok {rc=0} 04:05:25.630649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Launched 04:05:25.935972 run osmo-hlr_10.42.42.2(pid=6504): Launched 04:05:26.052333 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:26.579540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Launched 04:05:26.907885 run osmo-stp_10.42.42.5(pid=6507): Launched 04:05:27.034923 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:27.627465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Launched 04:05:27.955805 run osmo-msc_10.42.42.6(pid=6510): Launched 04:05:28.139927 run osmo-stp_10.42.42.5(pid=6507): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] 04:05:28.277608 run osmo-stp_10.42.42.5(pid=6507): stdout: | (launched: 2022-12-14_04:05:26.847763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:28.416243 run osmo-stp_10.42.42.5(pid=6507): stderr: | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040527041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:28.553685 run osmo-stp_10.42.42.5(pid=6507): stdout: | (launched: 2022-12-14_04:05:26.847763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:28.684642 run osmo-stp_10.42.42.5(pid=6507): stderr: | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040527041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040527041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040527043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:28.840254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6507): Process ended prematurely: osmo-stp_10.42.42.5(pid=6507) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:05:28.850024 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:05:28.877800 run osmo-hlr_10.42.42.2(pid=6504): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6504)] 04:05:28.928805 run osmo-hlr_10.42.42.2(pid=6504): stdout: | (launched: 2022-12-14_04:05:25.879460) 04:05:28.981341 run osmo-hlr_10.42.42.2(pid=6504): stderr: | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040526057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040526069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040526078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040526078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040526078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:29.053925 run osmo-msc_10.42.42.6(pid=6510): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6510)] 04:05:29.104233 run osmo-msc_10.42.42.6(pid=6510): stdout: | (launched: 2022-12-14_04:05:27.895647) 04:05:29.156688 run osmo-msc_10.42.42.6(pid=6510): stderr: | [0;m[38;5;43m20221214040528217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040528217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a3c038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040528217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040528217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040528217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040528217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040528219 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040528219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040528220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040528220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:29.209557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Terminating (SIGTERM) 04:05:29.251398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Terminating (SIGTERM) 04:05:29.293760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Terminating (SIGTERM) 04:05:29.336292 --- ParallelTerminationStrategy: PID 6503 died... 04:05:29.356634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Terminated: ok {rc=0} 04:05:29.403498 --- ParallelTerminationStrategy: PID 6506 died... 04:05:29.423394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Terminated: ok {rc=0} 04:05:29.470138 --- ParallelTerminationStrategy: PID 6509 died... 04:05:29.490238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Terminated: ok {rc=0} 04:05:29.578808 bus /sierra_3: Setting Powered False 04:05:30.677502 bus /sierra_3: Setting Powered False 04:05:31.794291 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:05:32.947846 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:32.960266 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:05:33.035752 tst mo_mt_call_osmux.py: using LAC 38426 04:05:33.164182 tst mo_mt_call_osmux.py: using RAC 176 04:05:33.292188 tst mo_mt_call_osmux.py: using CellId 38426 04:05:33.422111 tst mo_mt_call_osmux.py: using BVCI 38427 04:05:33.543577 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:33.555454 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:33.567068 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:33.578684 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:33.591280 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:05:33.603289 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:33.721758 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:05:33.841885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:34.312941 run create_hlr_db(pid=6512): Launched 04:05:34.438385 bus /sierra_2: Setting Powered False 04:05:35.499009 run create_hlr_db(pid=6512): Terminated: ok {rc=0} 04:05:35.945442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Launched 04:05:36.274442 run osmo-hlr_10.42.42.2(pid=6515): Launched 04:05:36.401252 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:36.968115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Launched 04:05:37.295717 run osmo-stp_10.42.42.5(pid=6518): Launched 04:05:37.421783 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:38.014264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Launched 04:05:38.341875 run osmo-msc_10.42.42.6(pid=6521): Launched 04:05:38.525253 run osmo-stp_10.42.42.5(pid=6518): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] 04:05:38.663311 run osmo-stp_10.42.42.5(pid=6518): stdout: | (launched: 2022-12-14_04:05:37.235446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:38.802453 run osmo-stp_10.42.42.5(pid=6518): stderr: | [0;m[38;5;43m20221214040537427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040537427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040537428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040537428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040537428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040537429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040537429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:38.940533 run osmo-stp_10.42.42.5(pid=6518): stdout: | (launched: 2022-12-14_04:05:37.235446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:39.071001 run osmo-stp_10.42.42.5(pid=6518): stderr: | [0;m[38;5;43m20221214040537427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040537427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040537428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040537428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040537428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040537429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040537429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:39.226329 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6518): Process ended prematurely: osmo-stp_10.42.42.5(pid=6518) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:05:39.236069 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:05:39.264078 run osmo-hlr_10.42.42.2(pid=6515): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6515)] 04:05:39.315221 run osmo-hlr_10.42.42.2(pid=6515): stdout: | (launched: 2022-12-14_04:05:36.214046) 04:05:39.368102 run osmo-hlr_10.42.42.2(pid=6515): stderr: | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040536412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040536424 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040536433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040536434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040536434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:39.441101 run osmo-msc_10.42.42.6(pid=6521): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6521)] 04:05:39.491848 run osmo-msc_10.42.42.6(pid=6521): stdout: | (launched: 2022-12-14_04:05:38.281573) 04:05:39.544601 run osmo-msc_10.42.42.6(pid=6521): stderr: | [0;m[38;5;43m20221214040538604 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040538604 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f429ce0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040538604 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040538604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040538604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040538604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040538606 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040538606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040538607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040538607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:39.597601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Terminating (SIGTERM) 04:05:39.639470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Terminating (SIGTERM) 04:05:39.681900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Terminating (SIGTERM) 04:05:39.724473 --- ParallelTerminationStrategy: PID 6514 died... 04:05:39.744845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6514): Terminated: ok {rc=0} 04:05:39.792194 --- ParallelTerminationStrategy: PID 6517 died... 04:05:39.812213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6517): Terminated: ok {rc=0} 04:05:39.858924 --- ParallelTerminationStrategy: PID 6520 died... 04:05:39.878943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6520): Terminated: ok {rc=0} 04:05:39.967867 bus /sierra_3: Setting Powered False 04:05:41.067317 bus /sierra_3: Setting Powered False 04:05:42.181330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 04:05:43.436085 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:05:43.441557 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:05:43.475022 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:05:43.501665 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:05:43.586713 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:05:43.619872 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:05:43.646274 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:05:44.230243 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 04:05:44.235502 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.246633 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:44.295857 tst emergency_mo_mt_call.py: using LAC 38427 04:05:44.413456 tst emergency_mo_mt_call.py: using RAC 177 04:05:44.539387 tst emergency_mo_mt_call.py: using CellId 38427 04:05:44.664263 tst emergency_mo_mt_call.py: using BVCI 38428 04:05:44.780578 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.791956 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.803033 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.814149 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.825566 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:44.836880 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:44.954072 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:45.073539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:45.569402 run create_hlr_db(pid=6526): Launched 04:05:45.693217 bus /sierra_2: Setting Powered False 04:05:46.785709 run create_hlr_db(pid=6526): Terminated: ok {rc=0} 04:05:47.304938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Launched 04:05:47.606086 run osmo-hlr_10.42.42.2(pid=6529): Launched 04:05:47.722527 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:48.255164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Launched 04:05:48.554411 run osmo-stp_10.42.42.5(pid=6532): Launched 04:05:48.678729 tst emergency_mo_mt_call.py: using MSISDN 8496 04:05:48.847379 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:49.387251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Launched 04:05:49.688338 run osmo-msc_10.42.42.6(pid=6535): Launched 04:05:49.855623 run osmo-stp_10.42.42.5(pid=6532): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] 04:05:49.982415 run osmo-stp_10.42.42.5(pid=6532): stdout: | (launched: 2022-12-14_04:05:48.498677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:50.109211 run osmo-stp_10.42.42.5(pid=6532): stderr: | [0;m[38;5;43m20221214040548672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040548672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040548673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040548673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040548673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040548674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040548674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:50.234381 run osmo-stp_10.42.42.5(pid=6532): stdout: | (launched: 2022-12-14_04:05:48.498677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:05:50.353287 run osmo-stp_10.42.42.5(pid=6532): stderr: | [0;m[38;5;43m20221214040548672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040548672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040548673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040548673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040548673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040548674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040548674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:05:50.495380 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6532): Process ended prematurely: osmo-stp_10.42.42.5(pid=6532) [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 04:05:50.503944 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 04:05:50.529944 run osmo-hlr_10.42.42.2(pid=6529): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6529)] 04:05:50.578273 run osmo-hlr_10.42.42.2(pid=6529): stdout: | (launched: 2022-12-14_04:05:47.550497) 04:05:50.628020 run osmo-hlr_10.42.42.2(pid=6529): stderr: | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040547725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040547737 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040547745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040547745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040547745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:05:50.697481 run osmo-msc_10.42.42.6(pid=6535): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6535)] 04:05:50.745779 run osmo-msc_10.42.42.6(pid=6535): stdout: | (launched: 2022-12-14_04:05:49.632592) 04:05:50.795523 run osmo-msc_10.42.42.6(pid=6535): stderr: | [0;m[38;5;43m20221214040549903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040549903 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5ad65fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040549903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040549903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040549904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040549904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040549906 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040549906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040549906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040549906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:05:50.845462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Terminating (SIGTERM) 04:05:50.885199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Terminating (SIGTERM) 04:05:50.925120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Terminating (SIGTERM) 04:05:50.965328 --- ParallelTerminationStrategy: PID 6528 died... 04:05:50.984725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Terminated: ok {rc=0} 04:05:51.029995 --- ParallelTerminationStrategy: PID 6531 died... 04:05:51.048918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Terminated: ok {rc=0} 04:05:51.093222 --- ParallelTerminationStrategy: PID 6534 died... 04:05:51.112180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Terminated: ok {rc=0} 04:05:51.198902 bus /sierra_3: Setting Powered False 04:05:52.299432 bus /sierra_3: Setting Powered False 04:05:53.418040 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 04:05:54.505936 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:54.517707 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:05:54.570352 tst emergency_preemptive_call.py: using LAC 38428 04:05:54.693517 tst emergency_preemptive_call.py: using RAC 178 04:05:54.811474 tst emergency_preemptive_call.py: using CellId 38428 04:05:54.930157 tst emergency_preemptive_call.py: using BVCI 38429 04:05:55.038269 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:55.049433 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:55.060288 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:55.071075 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:55.081788 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:05:55.092439 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:55.212419 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:55.333586 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:55.448437 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:05:55.566654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:05:56.065677 run create_hlr_db(pid=6537): Launched 04:05:56.190155 bus /sierra_2: Setting Powered False 04:05:57.253719 run create_hlr_db(pid=6537): Terminated: ok {rc=0} 04:05:57.703515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Launched 04:05:58.025882 run osmo-hlr_10.42.42.2(pid=6540): Launched 04:05:58.151253 run osmo-stp_10.42.42.5: Starting osmo-stp 04:05:58.705832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Launched 04:05:59.030152 run osmo-stp_10.42.42.5(pid=6543): Launched 04:05:59.164735 tst emergency_preemptive_call.py: using MSISDN 8497 04:05:59.331488 run osmo-msc_10.42.42.6: Starting osmo-msc 04:05:59.909121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6545): Launched 04:06:00.230316 run osmo-msc_10.42.42.6(pid=6546): Launched 04:06:00.410844 run osmo-stp_10.42.42.5(pid=6543): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] 04:06:00.545738 run osmo-stp_10.42.42.5(pid=6543): stdout: | (launched: 2022-12-14_04:05:58.970328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:00.682187 run osmo-stp_10.42.42.5(pid=6543): stderr: | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040559165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:00.817293 run osmo-stp_10.42.42.5(pid=6543): stdout: | (launched: 2022-12-14_04:05:58.970328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:00.947693 run osmo-stp_10.42.42.5(pid=6543): stderr: | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040559164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040559165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040559165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:01.104706 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6543): Process ended prematurely: osmo-stp_10.42.42.5(pid=6543) [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 04:06:01.114878 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 04:06:01.143741 run osmo-hlr_10.42.42.2(pid=6540): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6540)] 04:06:01.204163 run osmo-hlr_10.42.42.2(pid=6540): stdout: | (launched: 2022-12-14_04:05:57.966165) 04:06:01.279187 run osmo-hlr_10.42.42.2(pid=6540): stderr: | [0;m[1;31m20221214040558164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040558164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040558164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040558164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040558164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040558165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040558177 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040558185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040558185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040558185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:01.365519 run osmo-msc_10.42.42.6(pid=6546): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6546)] 04:06:01.421212 run osmo-msc_10.42.42.6(pid=6546): stdout: | (launched: 2022-12-14_04:06:00.170857) 04:06:01.477469 run osmo-msc_10.42.42.6(pid=6546): stderr: | [0;m[38;5;43m20221214040600493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214040600493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc30ca79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214040600493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214040600493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214040600493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214040600493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214040600495 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214040600495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214040600496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214040600496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:06:01.534099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Terminating (SIGTERM) 04:06:01.578751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Terminating (SIGTERM) 04:06:01.623941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6545): Terminating (SIGTERM) 04:06:01.669109 --- ParallelTerminationStrategy: PID 6539 died... 04:06:01.691129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6539): Terminated: ok {rc=0} 04:06:01.740033 --- ParallelTerminationStrategy: PID 6542 died... 04:06:01.761759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6542): Terminated: ok {rc=0} 04:06:01.811825 --- ParallelTerminationStrategy: PID 6545 died... 04:06:01.832694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6545): Terminated: ok {rc=0} 04:06:01.926379 bus /sierra_9: Setting Powered False 04:06:03.027236 bus /sierra_9: Setting Powered False 04:06:04.143709 bus /sierra_8: Setting Powered False 04:06:05.243016 bus /sierra_8: Setting Powered False 04:06:06.359179 bus /sierra_3: Setting Powered False 04:06:07.459625 bus /sierra_3: Setting Powered False 04:06:08.575089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 04:06:09.853687 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:06:09.857996 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 04:06:09.890895 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 04:06:09.929454 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 04:06:10.015994 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 04:06:10.050710 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 04:06:10.090644 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 04:06:10.680190 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 04:06:10.733613 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:10.744658 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:10.794689 tst cs_paging_gprs_active.py: using LAC 38429 04:06:10.921488 tst cs_paging_gprs_active.py: using RAC 179 04:06:11.039299 tst cs_paging_gprs_active.py: using CellId 38429 04:06:11.157593 tst cs_paging_gprs_active.py: using BVCI 38430 04:06:11.267632 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.278470 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.289146 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.299740 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.310379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.320900 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.331713 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.342292 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:11.352992 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:11.472163 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:11.587701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:06:11.787364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:12.086730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Launched 04:06:12.347135 run iperf3-srv_10.42.42.10(pid=6553): Launched 04:06:12.459548 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:06:12.658819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:12.958349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Launched 04:06:13.217985 run iperf3-srv_10.42.42.10(pid=6555): Launched 04:06:13.329907 tst cs_paging_gprs_active.py:38: start network... 04:06:13.528716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:13.990603 run create_hlr_db(pid=6556): Launched 04:06:14.113173 bus /sierra_2: Setting Powered False 04:06:15.172636 run create_hlr_db(pid=6556): Terminated: ok {rc=0} 04:06:15.587611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Launched 04:06:15.925650 run osmo-hlr_10.42.42.2(pid=6559): Launched 04:06:16.169226 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:16.832417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Launched 04:06:17.183509 run osmo-stp_10.42.42.5(pid=6562): Launched 04:06:17.320179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:17.878354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Launched 04:06:18.001257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:18.272867 run patchelf(pid=6565): Launched 04:06:18.450581 run osmo-stp_10.42.42.5(pid=6562): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] 04:06:18.585988 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-14_04:06:17.120142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:18.723098 run osmo-stp_10.42.42.5(pid=6562): stderr: | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040617325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040617325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040617326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040617326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:18.860358 run osmo-stp_10.42.42.5(pid=6562): stdout: | (launched: 2022-12-14_04:06:17.120142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:18.991867 run osmo-stp_10.42.42.5(pid=6562): stderr: | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040617324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040617325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040617325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040617326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040617326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:19.148072 run patchelf(pid=6565): Terminating (SIGINT) 04:06:19.327048 run patchelf(pid=6565): Terminated: ok {rc=0} 04:06:19.456245 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2399↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] [trial-2399↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 04:06:19.466490 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:06:19.495025 run osmo-hlr_10.42.42.2(pid=6559): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6559)] 04:06:19.546402 run osmo-hlr_10.42.42.2(pid=6559): stdout: | (launched: 2022-12-14_04:06:15.832872) 04:06:19.599007 run osmo-hlr_10.42.42.2(pid=6559): stderr: | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040616162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040616175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040616188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040616188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040616188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:19.652113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminating (SIGTERM) 04:06:19.694140 run iperf3-srv_10.42.42.10(pid=6553): Terminating (SIGTERM) 04:06:19.736415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Terminating (SIGTERM) 04:06:19.779094 run iperf3-srv_10.42.42.10(pid=6555): Terminating (SIGTERM) 04:06:19.821156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminating (SIGTERM) 04:06:19.863248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminating (SIGTERM) 04:06:19.905390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Terminating (SIGTERM) 04:06:19.947688 --- ParallelTerminationStrategy: PID 6552 died... 04:06:19.967954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6552): Terminated: ok {rc=0} 04:06:20.015505 --- ParallelTerminationStrategy: PID 6553 died... 04:06:20.035410 run iperf3-srv_10.42.42.10(pid=6553): Terminated {rc=256} 04:06:20.081901 --- ParallelTerminationStrategy: PID 6554 died... 04:06:20.101752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6554): Terminated: ok {rc=0} 04:06:20.148093 --- ParallelTerminationStrategy: PID 6555 died... 04:06:20.167914 run iperf3-srv_10.42.42.10(pid=6555): Terminated {rc=256} 04:06:20.214064 --- ParallelTerminationStrategy: PID 6558 died... 04:06:20.233901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6558): Terminated: ok {rc=0} 04:06:20.280141 --- ParallelTerminationStrategy: PID 6561 died... 04:06:20.300029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6561): Terminated: ok {rc=0} 04:06:20.346588 --- ParallelTerminationStrategy: PID 6564 died... 04:06:20.366605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6564): Terminated: ok {rc=0} 04:06:20.455321 bus /gobi_0: Setting Powered False 04:06:21.555299 bus /gobi_0: Setting Powered False 04:06:22.671718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 04:06:23.821342 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:23.832927 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:23.886373 tst iperf3.py: using LAC 38430 04:06:24.011635 tst iperf3.py: using RAC 180 04:06:24.138773 tst iperf3.py: using CellId 38430 04:06:24.263643 tst iperf3.py: using BVCI 38431 04:06:24.380004 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.391313 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.402179 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.412899 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.423969 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.435115 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.446570 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.458023 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:24.469274 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:24.583707 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:24.782451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:25.082063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Launched 04:06:25.341296 run iperf3-srv_10.42.42.10(pid=6567): Launched 04:06:25.453119 tst iperf3.py:8: start network... 04:06:25.650984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:26.114222 run create_hlr_db(pid=6568): Launched 04:06:26.236825 bus /gobi_6: Setting Powered False 04:06:27.296664 run create_hlr_db(pid=6568): Terminated: ok {rc=0} 04:06:27.711880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Launched 04:06:28.010062 run osmo-hlr_10.42.42.2(pid=6571): Launched 04:06:28.123200 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:28.656482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Launched 04:06:28.955418 run osmo-stp_10.42.42.5(pid=6574): Launched 04:06:29.069510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:29.585599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Launched 04:06:29.700051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:29.952168 run patchelf(pid=6577): Launched 04:06:30.118457 run osmo-stp_10.42.42.5(pid=6574): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] 04:06:30.244563 run osmo-stp_10.42.42.5(pid=6574): stdout: | (launched: 2022-12-14_04:06:28.899667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:30.372443 run osmo-stp_10.42.42.5(pid=6574): stderr: | [0;m[38;5;43m20221214040629066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040629066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040629067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040629067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:30.500299 run osmo-stp_10.42.42.5(pid=6574): stdout: | (launched: 2022-12-14_04:06:28.899667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:30.622601 run osmo-stp_10.42.42.5(pid=6574): stderr: | [0;m[38;5;43m20221214040629066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040629066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040629067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040629067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040629068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:30.768052 run patchelf(pid=6577): Terminating (SIGINT) 04:06:30.940535 run patchelf(pid=6577): Terminated: ok {rc=0} 04:06:31.064655 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6574): Process ended prematurely: osmo-stp_10.42.42.5(pid=6574) [trial-2399↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] [trial-2399↪gprs:trx-sysmocell5000↪iperf3.py:8] 04:06:31.075516 tst iperf3.py:8: Test FAILED (7.3 sec) 04:06:31.104112 run osmo-hlr_10.42.42.2(pid=6571): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6571)] 04:06:31.153535 run osmo-hlr_10.42.42.2(pid=6571): stdout: | (launched: 2022-12-14_04:06:27.954967) 04:06:31.204479 run osmo-hlr_10.42.42.2(pid=6571): stderr: | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040628127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040628139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040628148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040628148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040628148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:31.255595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Terminating (SIGTERM) 04:06:31.296876 run iperf3-srv_10.42.42.10(pid=6567): Terminating (SIGTERM) 04:06:31.337352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Terminating (SIGTERM) 04:06:31.377954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Terminating (SIGTERM) 04:06:31.426503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Terminating (SIGTERM) 04:06:31.487081 --- ParallelTerminationStrategy: PID 6566 died... 04:06:31.513057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6566): Terminated: ok {rc=0} 04:06:31.575382 --- ParallelTerminationStrategy: PID 6567 died... 04:06:31.601947 run iperf3-srv_10.42.42.10(pid=6567): Terminated {rc=256} 04:06:31.668592 --- ParallelTerminationStrategy: PID 6570 died... 04:06:31.694089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6570): Terminated: ok {rc=0} 04:06:31.745747 --- ParallelTerminationStrategy: PID 6573 died... 04:06:31.766190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6573): Terminated: ok {rc=0} 04:06:31.814812 --- ParallelTerminationStrategy: PID 6576 died... 04:06:31.835912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6576): Terminated: ok {rc=0} 04:06:31.929512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 04:06:33.079111 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.090707 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:33.140325 tst iperf3m4.py: using LAC 38431 04:06:33.257651 tst iperf3m4.py: using RAC 181 04:06:33.375278 tst iperf3m4.py: using CellId 38431 04:06:33.492005 tst iperf3m4.py: using BVCI 38432 04:06:33.598717 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.609550 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.620052 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.630674 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.641179 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.651577 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.662241 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.672633 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:33.683623 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:33.798337 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:33.917761 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:34.038240 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:34.152918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:06:34.350041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:34.646564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Launched 04:06:34.903836 run iperf3-srv_10.42.42.10(pid=6579): Launched 04:06:35.015272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:06:35.213997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:35.512246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Launched 04:06:35.769201 run iperf3-srv_10.42.42.10(pid=6581): Launched 04:06:35.880021 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:06:36.076158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:36.372017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Launched 04:06:36.630064 run iperf3-srv_10.42.42.10(pid=6583): Launched 04:06:36.751603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:06:36.964487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:06:37.284339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Launched 04:06:37.560239 run iperf3-srv_10.42.42.10(pid=6585): Launched 04:06:37.680019 tst iperf3m4.py:8: start network... 04:06:37.892771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:38.385900 run create_hlr_db(pid=6586): Launched 04:06:38.508090 bus /gobi_6: Setting Powered False 04:06:39.570608 run create_hlr_db(pid=6586): Terminated: ok {rc=0} 04:06:39.994225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Launched 04:06:40.291184 run osmo-hlr_10.42.42.2(pid=6589): Launched 04:06:40.404444 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:40.934910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Launched 04:06:41.234221 run osmo-stp_10.42.42.5(pid=6592): Launched 04:06:41.347864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:41.864094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Launched 04:06:41.978518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:42.234912 run patchelf(pid=6595): Launched 04:06:42.414586 run osmo-stp_10.42.42.5(pid=6592): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] 04:06:42.540491 run osmo-stp_10.42.42.5(pid=6592): stdout: | (launched: 2022-12-14_04:06:41.178768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:42.667919 run osmo-stp_10.42.42.5(pid=6592): stderr: | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040641347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:42.795497 run osmo-stp_10.42.42.5(pid=6592): stdout: | (launched: 2022-12-14_04:06:41.178768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:42.917346 run osmo-stp_10.42.42.5(pid=6592): stderr: | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040641346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040641347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040641347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:43.061809 run patchelf(pid=6595): Terminating (SIGINT) 04:06:43.229882 run patchelf(pid=6595): Terminated: ok {rc=0} 04:06:43.350269 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6592): Process ended prematurely: osmo-stp_10.42.42.5(pid=6592) [trial-2399↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] [trial-2399↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 04:06:43.359664 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:06:43.387229 run osmo-hlr_10.42.42.2(pid=6589): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6589)] 04:06:43.435314 run osmo-hlr_10.42.42.2(pid=6589): stdout: | (launched: 2022-12-14_04:06:40.236569) 04:06:43.485319 run osmo-hlr_10.42.42.2(pid=6589): stderr: | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040640407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040640419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040640428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040640428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040640429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:43.535625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Terminating (SIGTERM) 04:06:43.575797 run iperf3-srv_10.42.42.10(pid=6579): Terminating (SIGTERM) 04:06:43.615932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Terminating (SIGTERM) 04:06:43.656171 run iperf3-srv_10.42.42.10(pid=6581): Terminating (SIGTERM) 04:06:43.696115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Terminating (SIGTERM) 04:06:43.736156 run iperf3-srv_10.42.42.10(pid=6583): Terminating (SIGTERM) 04:06:43.776104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminating (SIGTERM) 04:06:43.816167 run iperf3-srv_10.42.42.10(pid=6585): Terminating (SIGTERM) 04:06:43.856116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Terminating (SIGTERM) 04:06:43.896085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Terminating (SIGTERM) 04:06:43.936197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Terminating (SIGTERM) 04:06:43.976581 --- ParallelTerminationStrategy: PID 6578 died... 04:06:43.995872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6578): Terminated: ok {rc=0} 04:06:44.040117 --- ParallelTerminationStrategy: PID 6579 died... 04:06:44.058900 run iperf3-srv_10.42.42.10(pid=6579): Terminated {rc=256} 04:06:44.102776 --- ParallelTerminationStrategy: PID 6580 died... 04:06:44.121751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6580): Terminated: ok {rc=0} 04:06:44.165534 --- ParallelTerminationStrategy: PID 6581 died... 04:06:44.184140 run iperf3-srv_10.42.42.10(pid=6581): Terminated {rc=256} 04:06:44.227945 --- ParallelTerminationStrategy: PID 6582 died... 04:06:44.246525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6582): Terminated: ok {rc=0} 04:06:44.290744 --- ParallelTerminationStrategy: PID 6583 died... 04:06:44.309391 run iperf3-srv_10.42.42.10(pid=6583): Terminated {rc=256} 04:06:44.353366 --- ParallelTerminationStrategy: PID 6584 died... 04:06:44.372134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6584): Terminated: ok {rc=0} 04:06:44.416035 --- ParallelTerminationStrategy: PID 6585 died... 04:06:44.434805 run iperf3-srv_10.42.42.10(pid=6585): Terminated {rc=256} 04:06:44.478757 --- ParallelTerminationStrategy: PID 6588 died... 04:06:44.497469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6588): Terminated: ok {rc=0} 04:06:44.541669 --- ParallelTerminationStrategy: PID 6591 died... 04:06:44.560427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6591): Terminated: ok {rc=0} 04:06:44.605057 --- ParallelTerminationStrategy: PID 6594 died... 04:06:44.623853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6594): Terminated: ok {rc=0} 04:06:44.707764 bus /gobi_4: Setting Powered False 04:06:45.805808 bus /gobi_4: Setting Powered False 04:06:46.930425 bus /gobi_1: Setting Powered False 04:06:48.031258 bus /gobi_1: Setting Powered False 04:06:49.147019 bus /gobi_0: Setting Powered False 04:06:50.245586 bus /gobi_0: Setting Powered False 04:06:51.365370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 04:06:52.469650 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:52.480929 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:06:52.533478 tst ping.py: using LAC 38432 04:06:52.656119 tst ping.py: using RAC 182 04:06:52.777372 tst ping.py: using CellId 38432 04:06:52.898197 tst ping.py: using BVCI 38433 04:06:53.011692 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.023209 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.034316 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.045309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.056456 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.067662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.079186 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:06:53.090541 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:06:53.205045 tst ping.py:19: start network... 04:06:53.398568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:06:53.847181 run create_hlr_db(pid=6596): Launched 04:06:53.965841 bus /gobi_6: Setting Powered False 04:06:55.023119 run create_hlr_db(pid=6596): Terminated: ok {rc=0} 04:06:55.449983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Launched 04:06:55.763483 run osmo-hlr_10.42.42.2(pid=6599): Launched 04:06:55.882360 run osmo-stp_10.42.42.5: Starting osmo-stp 04:06:56.426401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Launched 04:06:56.740371 run osmo-stp_10.42.42.5(pid=6602): Launched 04:06:56.858801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:06:57.400470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Launched 04:06:57.521140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:06:57.785292 run patchelf(pid=6605): Launched 04:06:57.960405 run osmo-stp_10.42.42.5(pid=6602): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] 04:06:58.094038 run osmo-stp_10.42.42.5(pid=6602): stdout: | (launched: 2022-12-14_04:06:56.683085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:58.229185 run osmo-stp_10.42.42.5(pid=6602): stderr: | [0;m[38;5;43m20221214040656870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040656871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040656871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040656871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:58.364202 run osmo-stp_10.42.42.5(pid=6602): stdout: | (launched: 2022-12-14_04:06:56.683085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:06:58.493198 run osmo-stp_10.42.42.5(pid=6602): stderr: | [0;m[38;5;43m20221214040656870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040656871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040656871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040656871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040656872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:06:58.645722 run patchelf(pid=6605): Terminating (SIGINT) 04:06:58.821079 run patchelf(pid=6605): Terminated: ok {rc=0} 04:06:58.947182 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6602): Process ended prematurely: osmo-stp_10.42.42.5(pid=6602) [trial-2399↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] [trial-2399↪gprs:trx-sysmocell5000↪ping.py:22] 04:06:58.956615 tst ping.py:22: Test FAILED (6.5 sec) 04:06:58.984734 run osmo-hlr_10.42.42.2(pid=6599): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6599)] 04:06:59.036044 run osmo-hlr_10.42.42.2(pid=6599): stdout: | (launched: 2022-12-14_04:06:55.706091) 04:06:59.089371 run osmo-hlr_10.42.42.2(pid=6599): stderr: | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040655899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040655915 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040655925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040655925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040655925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:06:59.142065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Terminating (SIGTERM) 04:06:59.183701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Terminating (SIGTERM) 04:06:59.225926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Terminating (SIGTERM) 04:06:59.268788 --- ParallelTerminationStrategy: PID 6598 died... 04:06:59.289223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6598): Terminated: ok {rc=0} 04:06:59.335909 --- ParallelTerminationStrategy: PID 6601 died... 04:06:59.355884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6601): Terminated: ok {rc=0} 04:06:59.402116 --- ParallelTerminationStrategy: PID 6604 died... 04:06:59.421911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6604): Terminated: ok {rc=0} 04:06:59.509828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 04:07:00.596661 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:00.608568 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 04:07:00.659891 tst ping_idle_ping.py: using LAC 38433 04:07:00.776727 tst ping_idle_ping.py: using RAC 183 04:07:00.896194 tst ping_idle_ping.py: using CellId 38433 04:07:01.038086 tst ping_idle_ping.py: using BVCI 38434 04:07:01.179978 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.194454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.208436 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.223535 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.237402 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.251551 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.266015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 04:07:01.281339 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 04:07:01.402917 tst ping_idle_ping.py:24: start network... 04:07:01.635368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:02.136535 run create_hlr_db(pid=6606): Launched 04:07:02.295440 bus /gobi_6: Setting Powered False 04:07:03.358288 run create_hlr_db(pid=6606): Terminated: ok {rc=0} 04:07:03.796139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Launched 04:07:04.110620 run osmo-hlr_10.42.42.2(pid=6609): Launched 04:07:04.231618 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:04.774404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Launched 04:07:05.087655 run osmo-stp_10.42.42.5(pid=6612): Launched 04:07:05.206644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:05.745369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Launched 04:07:05.864472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:06.129389 run patchelf(pid=6615): Launched 04:07:06.303693 run osmo-stp_10.42.42.5(pid=6612): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] 04:07:06.437286 run osmo-stp_10.42.42.5(pid=6612): stdout: | (launched: 2022-12-14_04:07:05.030374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:06.572744 run osmo-stp_10.42.42.5(pid=6612): stderr: | [0;m[38;5;43m20221214040705216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040705217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040705217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040705217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:06.708489 run osmo-stp_10.42.42.5(pid=6612): stdout: | (launched: 2022-12-14_04:07:05.030374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:06.838331 run osmo-stp_10.42.42.5(pid=6612): stderr: | [0;m[38;5;43m20221214040705216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040705217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040705217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040705217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040705218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:06.991171 run patchelf(pid=6615): Terminating (SIGINT) 04:07:07.168012 run patchelf(pid=6615): Terminated: ok {rc=0} 04:07:07.294913 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6612): Process ended prematurely: osmo-stp_10.42.42.5(pid=6612) [trial-2399↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] [trial-2399↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 04:07:07.304279 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:07:07.332133 run osmo-hlr_10.42.42.2(pid=6609): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6609)] 04:07:07.382429 run osmo-hlr_10.42.42.2(pid=6609): stdout: | (launched: 2022-12-14_04:07:04.052862) 04:07:07.434250 run osmo-hlr_10.42.42.2(pid=6609): stderr: | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040704247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040704259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040704267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040704267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040704267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:07.486372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Terminating (SIGTERM) 04:07:07.527754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Terminating (SIGTERM) 04:07:07.569520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Terminating (SIGTERM) 04:07:07.611509 --- ParallelTerminationStrategy: PID 6608 died... 04:07:07.631846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6608): Terminated: ok {rc=0} 04:07:07.678011 --- ParallelTerminationStrategy: PID 6611 died... 04:07:07.697780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6611): Terminated: ok {rc=0} 04:07:07.743628 --- ParallelTerminationStrategy: PID 6614 died... 04:07:07.763440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6614): Terminated: ok {rc=0} 04:07:07.851067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 04:07:09.159590 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:07:09.165224 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:07:09.198614 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:07:09.237297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:07:09.323413 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:07:09.356593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:07:09.394348 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:07:09.989847 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:07:10.037826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.048798 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:10.099383 tst cs_paging_gprs_active.py: using LAC 38434 04:07:10.219229 tst cs_paging_gprs_active.py: using RAC 184 04:07:10.338492 tst cs_paging_gprs_active.py: using CellId 38434 04:07:10.457328 tst cs_paging_gprs_active.py: using BVCI 38435 04:07:10.565718 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.576520 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.587233 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.597872 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.609159 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.620605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.631934 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.643342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:10.654812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:10.775010 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:10.891439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:07:11.090999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:11.389978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Launched 04:07:11.649234 run iperf3-srv_10.42.42.10(pid=6620): Launched 04:07:11.760367 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:07:11.959551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:12.258298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Launched 04:07:12.516939 run iperf3-srv_10.42.42.10(pid=6622): Launched 04:07:12.628215 tst cs_paging_gprs_active.py:38: start network... 04:07:12.826594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:13.288196 run create_hlr_db(pid=6623): Launched 04:07:13.411851 bus /gobi_6: Setting Powered False 04:07:14.470838 run create_hlr_db(pid=6623): Terminated: ok {rc=0} 04:07:14.906826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Launched 04:07:15.229696 run osmo-hlr_10.42.42.2(pid=6626): Launched 04:07:15.352656 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:15.913622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Launched 04:07:16.258215 run osmo-stp_10.42.42.5(pid=6629): Launched 04:07:16.527910 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:17.092590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Launched 04:07:17.227258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:17.498353 run patchelf(pid=6632): Launched 04:07:17.678560 run osmo-stp_10.42.42.5(pid=6629): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] 04:07:17.814849 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-14_04:07:16.196935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:17.952540 run osmo-stp_10.42.42.5(pid=6629): stderr: | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040716473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:18.091250 run osmo-stp_10.42.42.5(pid=6629): stdout: | (launched: 2022-12-14_04:07:16.196935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:18.223172 run osmo-stp_10.42.42.5(pid=6629): stderr: | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040716472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040716473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040716473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:18.379267 run patchelf(pid=6632): Terminating (SIGINT) 04:07:18.558183 run patchelf(pid=6632): Terminated: ok {rc=0} 04:07:18.687169 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:07:18.697411 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:07:18.725846 run osmo-hlr_10.42.42.2(pid=6626): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6626)] 04:07:18.776280 run osmo-hlr_10.42.42.2(pid=6626): stdout: | (launched: 2022-12-14_04:07:15.171360) 04:07:18.828431 run osmo-hlr_10.42.42.2(pid=6626): stderr: | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040715365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040715377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040715386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040715386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040715386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:18.881265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminating (SIGTERM) 04:07:18.922899 run iperf3-srv_10.42.42.10(pid=6620): Terminating (SIGTERM) 04:07:18.964862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminating (SIGTERM) 04:07:19.006954 run iperf3-srv_10.42.42.10(pid=6622): Terminating (SIGTERM) 04:07:19.050541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminating (SIGTERM) 04:07:19.093330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminating (SIGTERM) 04:07:19.135331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminating (SIGTERM) 04:07:19.177759 --- ParallelTerminationStrategy: PID 6619 died... 04:07:19.198031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6619): Terminated: ok {rc=0} 04:07:19.244322 --- ParallelTerminationStrategy: PID 6620 died... 04:07:19.263936 run iperf3-srv_10.42.42.10(pid=6620): Terminated {rc=256} 04:07:19.310267 --- ParallelTerminationStrategy: PID 6621 died... 04:07:19.329985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6621): Terminated: ok {rc=0} 04:07:19.376231 --- ParallelTerminationStrategy: PID 6622 died... 04:07:19.395909 run iperf3-srv_10.42.42.10(pid=6622): Terminated {rc=256} 04:07:19.442189 --- ParallelTerminationStrategy: PID 6625 died... 04:07:19.462123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6625): Terminated: ok {rc=0} 04:07:19.508271 --- ParallelTerminationStrategy: PID 6628 died... 04:07:19.528287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6628): Terminated: ok {rc=0} 04:07:19.574553 --- ParallelTerminationStrategy: PID 6631 died... 04:07:19.594243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6631): Terminated: ok {rc=0} 04:07:19.681360 bus /gobi_0: Setting Powered False 04:07:20.779756 bus /gobi_0: Setting Powered False 04:07:21.895992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:07:23.043396 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.055658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:23.110937 tst iperf3.py: using LAC 38435 04:07:23.241708 tst iperf3.py: using RAC 185 04:07:23.367227 tst iperf3.py: using CellId 38435 04:07:23.490528 tst iperf3.py: using BVCI 38436 04:07:23.606291 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.617791 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.628816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.639946 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.651276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.662723 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.674918 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.686500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:23.698215 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:23.816536 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:24.030549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:24.350087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Launched 04:07:24.627923 run iperf3-srv_10.42.42.10(pid=6634): Launched 04:07:24.747698 tst iperf3.py:8: start network... 04:07:24.961640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:25.456183 run create_hlr_db(pid=6635): Launched 04:07:25.577757 bus /gobi_6: Setting Powered False 04:07:26.640363 run create_hlr_db(pid=6635): Terminated: ok {rc=0} 04:07:27.064674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Launched 04:07:27.360243 run osmo-hlr_10.42.42.2(pid=6638): Launched 04:07:27.473390 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:27.988894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Launched 04:07:28.285728 run osmo-stp_10.42.42.5(pid=6641): Launched 04:07:28.398851 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:28.910637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Launched 04:07:29.024087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:29.275619 run patchelf(pid=6644): Launched 04:07:29.441905 run osmo-stp_10.42.42.5(pid=6641): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] 04:07:29.568558 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-14_04:07:28.231292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:29.695878 run osmo-stp_10.42.42.5(pid=6641): stderr: | [0;m[38;5;43m20221214040728396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040728397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040728397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040728397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:29.823328 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-14_04:07:28.231292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:29.945382 run osmo-stp_10.42.42.5(pid=6641): stderr: | [0;m[38;5;43m20221214040728396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040728397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040728397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040728397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040728398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:30.090276 run patchelf(pid=6644): Terminating (SIGINT) 04:07:30.255763 run patchelf(pid=6644): Terminated: ok {rc=0} 04:07:30.376493 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 04:07:30.386211 tst iperf3.py:8: Test FAILED (7.4 sec) 04:07:30.413344 run osmo-hlr_10.42.42.2(pid=6638): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6638)] 04:07:30.461062 run osmo-hlr_10.42.42.2(pid=6638): stdout: | (launched: 2022-12-14_04:07:27.305845) 04:07:30.510384 run osmo-hlr_10.42.42.2(pid=6638): stderr: | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040727478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040727490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040727499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040727499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040727499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:30.559914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminating (SIGTERM) 04:07:30.599499 run iperf3-srv_10.42.42.10(pid=6634): Terminating (SIGTERM) 04:07:30.638952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminating (SIGTERM) 04:07:30.678798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminating (SIGTERM) 04:07:30.718428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Terminating (SIGTERM) 04:07:30.758301 --- ParallelTerminationStrategy: PID 6633 died... 04:07:30.776935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6633): Terminated: ok {rc=0} 04:07:30.820749 --- ParallelTerminationStrategy: PID 6634 died... 04:07:30.840409 run iperf3-srv_10.42.42.10(pid=6634): Terminated {rc=256} 04:07:30.899845 --- ParallelTerminationStrategy: PID 6637 died... 04:07:30.920672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminated: ok {rc=0} 04:07:30.969356 --- ParallelTerminationStrategy: PID 6640 died... 04:07:30.991480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminated: ok {rc=0} 04:07:31.040067 --- ParallelTerminationStrategy: PID 6643 died... 04:07:31.062826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6643): Terminated: ok {rc=0} 04:07:31.159587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:07:32.333823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.346149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:32.399985 tst iperf3m4.py: using LAC 38436 04:07:32.526560 tst iperf3m4.py: using RAC 186 04:07:32.651469 tst iperf3m4.py: using CellId 38436 04:07:32.769743 tst iperf3m4.py: using BVCI 38437 04:07:32.877158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.888072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.898814 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.909618 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.920428 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.931206 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.942087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.952716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:32.963598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:33.078427 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:33.200487 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:33.318890 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:33.439714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:07:33.655900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:33.977077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Launched 04:07:34.254869 run iperf3-srv_10.42.42.10(pid=6646): Launched 04:07:34.375166 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:07:34.589825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:34.911188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Launched 04:07:35.190510 run iperf3-srv_10.42.42.10(pid=6648): Launched 04:07:35.310926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:07:35.526629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:35.848942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Launched 04:07:36.127227 run iperf3-srv_10.42.42.10(pid=6650): Launched 04:07:36.248877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:07:36.464414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:07:36.786340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Launched 04:07:37.065687 run iperf3-srv_10.42.42.10(pid=6652): Launched 04:07:37.186347 tst iperf3m4.py:8: start network... 04:07:37.401814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:37.898718 run create_hlr_db(pid=6653): Launched 04:07:38.022090 bus /gobi_6: Setting Powered False 04:07:39.085567 run create_hlr_db(pid=6653): Terminated: ok {rc=0} 04:07:39.510915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Launched 04:07:39.809100 run osmo-hlr_10.42.42.2(pid=6656): Launched 04:07:39.921452 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:40.441626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Launched 04:07:40.740116 run osmo-stp_10.42.42.5(pid=6659): Launched 04:07:40.853846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:41.368329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Launched 04:07:41.481921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:41.733883 run patchelf(pid=6662): Launched 04:07:41.901203 run osmo-stp_10.42.42.5(pid=6659): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] 04:07:42.026998 run osmo-stp_10.42.42.5(pid=6659): stdout: | (launched: 2022-12-14_04:07:40.685268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:42.154484 run osmo-stp_10.42.42.5(pid=6659): stderr: | [0;m[38;5;43m20221214040740852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040740853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040740853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040740853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:42.281737 run osmo-stp_10.42.42.5(pid=6659): stdout: | (launched: 2022-12-14_04:07:40.685268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:42.403487 run osmo-stp_10.42.42.5(pid=6659): stderr: | [0;m[38;5;43m20221214040740852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040740853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040740853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040740853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040740854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:42.547520 run patchelf(pid=6662): Terminating (SIGINT) 04:07:42.714350 run patchelf(pid=6662): Terminated: ok {rc=0} 04:07:42.834430 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6659): Process ended prematurely: osmo-stp_10.42.42.5(pid=6659) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 04:07:42.844016 tst iperf3m4.py:8: Test FAILED (10.5 sec) 04:07:42.871286 run osmo-hlr_10.42.42.2(pid=6656): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6656)] 04:07:42.918550 run osmo-hlr_10.42.42.2(pid=6656): stdout: | (launched: 2022-12-14_04:07:39.754380) 04:07:42.967398 run osmo-hlr_10.42.42.2(pid=6656): stderr: | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040739926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040739938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040739948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040739948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040739948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:43.016766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminating (SIGTERM) 04:07:43.056166 run iperf3-srv_10.42.42.10(pid=6646): Terminating (SIGTERM) 04:07:43.095543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminating (SIGTERM) 04:07:43.134936 run iperf3-srv_10.42.42.10(pid=6648): Terminating (SIGTERM) 04:07:43.174124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminating (SIGTERM) 04:07:43.213429 run iperf3-srv_10.42.42.10(pid=6650): Terminating (SIGTERM) 04:07:43.252585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminating (SIGTERM) 04:07:43.291835 run iperf3-srv_10.42.42.10(pid=6652): Terminating (SIGTERM) 04:07:43.330948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Terminating (SIGTERM) 04:07:43.370454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Terminating (SIGTERM) 04:07:43.409615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Terminating (SIGTERM) 04:07:43.449251 --- ParallelTerminationStrategy: PID 6645 died... 04:07:43.468201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6645): Terminated: ok {rc=0} 04:07:43.511681 --- ParallelTerminationStrategy: PID 6646 died... 04:07:43.530085 run iperf3-srv_10.42.42.10(pid=6646): Terminated {rc=256} 04:07:43.573313 --- ParallelTerminationStrategy: PID 6647 died... 04:07:43.591704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6647): Terminated: ok {rc=0} 04:07:43.635408 --- ParallelTerminationStrategy: PID 6648 died... 04:07:43.654010 run iperf3-srv_10.42.42.10(pid=6648): Terminated {rc=256} 04:07:43.697802 --- ParallelTerminationStrategy: PID 6649 died... 04:07:43.716227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6649): Terminated: ok {rc=0} 04:07:43.759424 --- ParallelTerminationStrategy: PID 6650 died... 04:07:43.777780 run iperf3-srv_10.42.42.10(pid=6650): Terminated {rc=256} 04:07:43.821092 --- ParallelTerminationStrategy: PID 6651 died... 04:07:43.839397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6651): Terminated: ok {rc=0} 04:07:43.882758 --- ParallelTerminationStrategy: PID 6652 died... 04:07:43.901157 run iperf3-srv_10.42.42.10(pid=6652): Terminated {rc=256} 04:07:43.944279 --- ParallelTerminationStrategy: PID 6655 died... 04:07:43.962714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6655): Terminated: ok {rc=0} 04:07:44.006142 --- ParallelTerminationStrategy: PID 6658 died... 04:07:44.024654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6658): Terminated: ok {rc=0} 04:07:44.068074 --- ParallelTerminationStrategy: PID 6661 died... 04:07:44.086710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6661): Terminated: ok {rc=0} 04:07:44.171766 bus /gobi_4: Setting Powered False 04:07:45.269490 bus /gobi_4: Setting Powered False 04:07:46.382691 bus /gobi_1: Setting Powered False 04:07:47.493596 bus /gobi_1: Setting Powered False 04:07:48.607835 bus /gobi_0: Setting Powered False 04:07:49.706546 bus /gobi_0: Setting Powered False 04:07:50.820293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 04:07:51.924415 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:51.937119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:07:51.989662 tst ping.py: using LAC 38437 04:07:52.105386 tst ping.py: using RAC 187 04:07:52.219988 tst ping.py: using CellId 38437 04:07:52.339079 tst ping.py: using BVCI 38438 04:07:52.455983 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.468035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.479288 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.490820 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.502760 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.514821 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.527151 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:07:52.539249 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:07:52.655871 tst ping.py:19: start network... 04:07:52.866605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:07:53.349980 run create_hlr_db(pid=6663): Launched 04:07:53.469845 bus /gobi_6: Setting Powered False 04:07:54.532149 run create_hlr_db(pid=6663): Terminated: ok {rc=0} 04:07:54.968096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Launched 04:07:55.279944 run osmo-hlr_10.42.42.2(pid=6666): Launched 04:07:55.399486 run osmo-stp_10.42.42.5: Starting osmo-stp 04:07:55.941043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Launched 04:07:56.254642 run osmo-stp_10.42.42.5(pid=6669): Launched 04:07:56.375686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:07:56.916488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6671): Launched 04:07:57.036647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:07:57.302063 run patchelf(pid=6672): Launched 04:07:57.477579 run osmo-stp_10.42.42.5(pid=6669): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] 04:07:57.611470 run osmo-stp_10.42.42.5(pid=6669): stdout: | (launched: 2022-12-14_04:07:56.196888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:57.747347 run osmo-stp_10.42.42.5(pid=6669): stderr: | [0;m[38;5;43m20221214040756383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040756384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040756384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040756384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:57.883628 run osmo-stp_10.42.42.5(pid=6669): stdout: | (launched: 2022-12-14_04:07:56.196888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:07:58.012670 run osmo-stp_10.42.42.5(pid=6669): stderr: | [0;m[38;5;43m20221214040756383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040756384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040756384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040756384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040756385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:07:58.166504 run patchelf(pid=6672): Terminating (SIGINT) 04:07:58.343082 run patchelf(pid=6672): Terminated: ok {rc=0} 04:07:58.469818 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6669): Process ended prematurely: osmo-stp_10.42.42.5(pid=6669) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 04:07:58.479513 tst ping.py:22: Test FAILED (6.5 sec) 04:07:58.507867 run osmo-hlr_10.42.42.2(pid=6666): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6666)] 04:07:58.559062 run osmo-hlr_10.42.42.2(pid=6666): stdout: | (launched: 2022-12-14_04:07:55.223024) 04:07:58.611165 run osmo-hlr_10.42.42.2(pid=6666): stderr: | [0;m[1;31m20221214040755414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040755414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040755414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040755415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040755415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040755415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040755426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040755435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040755435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040755435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:07:58.663571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminating (SIGTERM) 04:07:58.705274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminating (SIGTERM) 04:07:58.747696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6671): Terminating (SIGTERM) 04:07:58.790441 --- ParallelTerminationStrategy: PID 6665 died... 04:07:58.810797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminated: ok {rc=0} 04:07:58.857768 --- ParallelTerminationStrategy: PID 6668 died... 04:07:58.877744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminated: ok {rc=0} 04:07:58.924398 --- ParallelTerminationStrategy: PID 6671 died... 04:07:58.944354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6671): Terminated: ok {rc=0} 04:07:59.032277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:08:00.120267 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.132359 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:08:00.185456 tst ping_idle_ping.py: using LAC 38438 04:08:00.301227 tst ping_idle_ping.py: using RAC 188 04:08:00.425601 tst ping_idle_ping.py: using CellId 38438 04:08:00.548863 tst ping_idle_ping.py: using BVCI 38439 04:08:00.663748 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.675207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.686498 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.697732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.709800 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.721769 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.734036 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:08:00.746144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:08:00.865744 tst ping_idle_ping.py:24: start network... 04:08:01.110078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:01.609074 run create_hlr_db(pid=6673): Launched 04:08:01.765459 bus /gobi_6: Setting Powered False 04:08:02.824399 run create_hlr_db(pid=6673): Terminated: ok {rc=0} 04:08:03.269056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6675): Launched 04:08:03.583778 run osmo-hlr_10.42.42.2(pid=6676): Launched 04:08:03.705500 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:04.244537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6678): Launched 04:08:04.560001 run osmo-stp_10.42.42.5(pid=6679): Launched 04:08:04.680754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:05.224343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6681): Launched 04:08:05.345257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:05.611095 run patchelf(pid=6682): Launched 04:08:05.786556 run osmo-stp_10.42.42.5(pid=6679): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6679)] 04:08:05.920320 run osmo-stp_10.42.42.5(pid=6679): stdout: | (launched: 2022-12-14_04:08:04.502552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:06.056341 run osmo-stp_10.42.42.5(pid=6679): stderr: | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040804689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:06.192252 run osmo-stp_10.42.42.5(pid=6679): stdout: | (launched: 2022-12-14_04:08:04.502552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:06.321944 run osmo-stp_10.42.42.5(pid=6679): stderr: | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040804688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040804689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040804689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:06.475009 run patchelf(pid=6682): Terminating (SIGINT) 04:08:06.651944 run patchelf(pid=6682): Terminated: ok {rc=0} 04:08:06.778573 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6679): Process ended prematurely: osmo-stp_10.42.42.5(pid=6679) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6679)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 04:08:06.788206 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:08:06.816165 run osmo-hlr_10.42.42.2(pid=6676): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6676)] 04:08:06.866626 run osmo-hlr_10.42.42.2(pid=6676): stdout: | (launched: 2022-12-14_04:08:03.526168) 04:08:06.919031 run osmo-hlr_10.42.42.2(pid=6676): stderr: | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040803720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040803732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040803740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040803740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040803740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:06.971096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6675): Terminating (SIGTERM) 04:08:07.012757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6678): Terminating (SIGTERM) 04:08:07.055077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6681): Terminating (SIGTERM) 04:08:07.097503 --- ParallelTerminationStrategy: PID 6675 died... 04:08:07.117839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6675): Terminated: ok {rc=0} 04:08:07.163967 --- ParallelTerminationStrategy: PID 6678 died... 04:08:07.183743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6678): Terminated: ok {rc=0} 04:08:07.230051 --- ParallelTerminationStrategy: PID 6681 died... 04:08:07.249925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6681): Terminated: ok {rc=0} 04:08:07.338360 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:08:08.650126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:08:08.657109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:08:08.693787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:08:08.732272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:08:08.817624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:08:08.850861 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:08:08.888836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:08:09.484259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:08:09.531726 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:09.542681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:09.611816 tst cs_paging_gprs_active.py: using LAC 38439 04:08:09.731946 tst cs_paging_gprs_active.py: using RAC 189 04:08:09.849053 tst cs_paging_gprs_active.py: using CellId 38439 04:08:09.964681 tst cs_paging_gprs_active.py: using BVCI 38440 04:08:10.072212 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.083208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.094032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.104691 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.115461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.126172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.137068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.147809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:10.158692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:10.277814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:10.392544 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:08:10.592389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:10.891160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Launched 04:08:11.150063 run iperf3-srv_10.42.42.10(pid=6687): Launched 04:08:11.261224 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:08:11.459911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:11.758002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Launched 04:08:12.017211 run iperf3-srv_10.42.42.10(pid=6689): Launched 04:08:12.128492 tst cs_paging_gprs_active.py:38: start network... 04:08:12.327325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:12.790871 run create_hlr_db(pid=6690): Launched 04:08:12.911767 bus /gobi_6: Setting Powered False 04:08:13.971219 run create_hlr_db(pid=6690): Terminated: ok {rc=0} 04:08:14.408714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Launched 04:08:14.727777 run osmo-hlr_10.42.42.2(pid=6693): Launched 04:08:14.848867 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:15.402320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6695): Launched 04:08:15.720675 run osmo-stp_10.42.42.5(pid=6696): Launched 04:08:15.871267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:16.472094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6698): Launched 04:08:16.597552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:16.861737 run patchelf(pid=6699): Launched 04:08:17.044327 run osmo-stp_10.42.42.5(pid=6696): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6696)] 04:08:17.175587 run osmo-stp_10.42.42.5(pid=6696): stdout: | (launched: 2022-12-14_04:08:15.662388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:17.313411 run osmo-stp_10.42.42.5(pid=6696): stderr: | [0;m[38;5;43m20221214040815863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040815863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040815864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040815864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:17.450880 run osmo-stp_10.42.42.5(pid=6696): stdout: | (launched: 2022-12-14_04:08:15.662388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:17.582545 run osmo-stp_10.42.42.5(pid=6696): stderr: | [0;m[38;5;43m20221214040815863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040815863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040815864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040815864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:17.737966 run patchelf(pid=6699): Terminating (SIGINT) 04:08:17.916925 run patchelf(pid=6699): Terminated: ok {rc=0} 04:08:18.046334 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6696): Process ended prematurely: osmo-stp_10.42.42.5(pid=6696) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6696)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:08:18.057396 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:08:18.086497 run osmo-hlr_10.42.42.2(pid=6693): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6693)] 04:08:18.137918 run osmo-hlr_10.42.42.2(pid=6693): stdout: | (launched: 2022-12-14_04:08:14.669733) 04:08:18.190567 run osmo-hlr_10.42.42.2(pid=6693): stderr: | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040814862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040814874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040814882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040814882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040814882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:18.243252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Terminating (SIGTERM) 04:08:18.285008 run iperf3-srv_10.42.42.10(pid=6687): Terminating (SIGTERM) 04:08:18.327056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Terminating (SIGTERM) 04:08:18.369156 run iperf3-srv_10.42.42.10(pid=6689): Terminating (SIGTERM) 04:08:18.411165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Terminating (SIGTERM) 04:08:18.453064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6695): Terminating (SIGTERM) 04:08:18.494987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6698): Terminating (SIGTERM) 04:08:18.537316 --- ParallelTerminationStrategy: PID 6686 died... 04:08:18.557481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6686): Terminated: ok {rc=0} 04:08:18.603747 --- ParallelTerminationStrategy: PID 6687 died... 04:08:18.623446 run iperf3-srv_10.42.42.10(pid=6687): Terminated {rc=256} 04:08:18.669590 --- ParallelTerminationStrategy: PID 6688 died... 04:08:18.689300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6688): Terminated: ok {rc=0} 04:08:18.735451 --- ParallelTerminationStrategy: PID 6689 died... 04:08:18.755123 run iperf3-srv_10.42.42.10(pid=6689): Terminated {rc=256} 04:08:18.801303 --- ParallelTerminationStrategy: PID 6692 died... 04:08:18.821064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6692): Terminated: ok {rc=0} 04:08:18.867158 --- ParallelTerminationStrategy: PID 6695 died... 04:08:18.887005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6695): Terminated: ok {rc=0} 04:08:18.933400 --- ParallelTerminationStrategy: PID 6698 died... 04:08:18.953267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6698): Terminated: ok {rc=0} 04:08:19.042057 bus /gobi_0: Setting Powered False 04:08:20.140216 bus /gobi_0: Setting Powered False 04:08:21.259233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:08:22.403827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:22.415458 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:22.487661 tst iperf3.py: using LAC 38440 04:08:22.608119 tst iperf3.py: using RAC 190 04:08:22.724535 tst iperf3.py: using CellId 38440 04:08:22.839250 tst iperf3.py: using BVCI 38441 04:08:22.946435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:22.957506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:22.968290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:22.979072 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:22.989807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:23.000515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:23.011422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:23.022146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:23.032928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:23.147218 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:23.344711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:23.642023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6700): Launched 04:08:23.902510 run iperf3-srv_10.42.42.10(pid=6701): Launched 04:08:24.015657 tst iperf3.py:8: start network... 04:08:24.212464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:24.674743 run create_hlr_db(pid=6702): Launched 04:08:24.797253 bus /gobi_6: Setting Powered False 04:08:25.857471 run create_hlr_db(pid=6702): Terminated: ok {rc=0} 04:08:26.272136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6704): Launched 04:08:26.569447 run osmo-hlr_10.42.42.2(pid=6705): Launched 04:08:26.684155 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:27.214409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6707): Launched 04:08:27.511028 run osmo-stp_10.42.42.5(pid=6708): Launched 04:08:27.624092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:28.140003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6710): Launched 04:08:28.253512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:28.504445 run patchelf(pid=6711): Launched 04:08:28.669609 run osmo-stp_10.42.42.5(pid=6708): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6708)] 04:08:28.795373 run osmo-stp_10.42.42.5(pid=6708): stdout: | (launched: 2022-12-14_04:08:27.456251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:28.922896 run osmo-stp_10.42.42.5(pid=6708): stderr: | [0;m[38;5;43m20221214040827623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040827623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040827624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040827624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:29.050141 run osmo-stp_10.42.42.5(pid=6708): stdout: | (launched: 2022-12-14_04:08:27.456251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:29.172410 run osmo-stp_10.42.42.5(pid=6708): stderr: | [0;m[38;5;43m20221214040827623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040827623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040827624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040827624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040827625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:29.316489 run patchelf(pid=6711): Terminating (SIGINT) 04:08:29.483015 run patchelf(pid=6711): Terminated: ok {rc=0} 04:08:29.603192 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6708): Process ended prematurely: osmo-stp_10.42.42.5(pid=6708) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6708)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 04:08:29.612587 tst iperf3.py:8: Test FAILED (7.2 sec) 04:08:29.639600 run osmo-hlr_10.42.42.2(pid=6705): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6705)] 04:08:29.687760 run osmo-hlr_10.42.42.2(pid=6705): stdout: | (launched: 2022-12-14_04:08:26.514665) 04:08:29.737093 run osmo-hlr_10.42.42.2(pid=6705): stderr: | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040826689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040826701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040826710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040826710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040826710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:29.786819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6700): Terminating (SIGTERM) 04:08:29.826328 run iperf3-srv_10.42.42.10(pid=6701): Terminating (SIGTERM) 04:08:29.865542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6704): Terminating (SIGTERM) 04:08:29.905114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6707): Terminating (SIGTERM) 04:08:29.944395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6710): Terminating (SIGTERM) 04:08:29.983906 --- ParallelTerminationStrategy: PID 6700 died... 04:08:30.002852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6700): Terminated: ok {rc=0} 04:08:30.046902 --- ParallelTerminationStrategy: PID 6701 died... 04:08:30.065737 run iperf3-srv_10.42.42.10(pid=6701): Terminated {rc=256} 04:08:30.109276 --- ParallelTerminationStrategy: PID 6704 died... 04:08:30.127639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6704): Terminated: ok {rc=0} 04:08:30.171069 --- ParallelTerminationStrategy: PID 6707 died... 04:08:30.189592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6707): Terminated: ok {rc=0} 04:08:30.232941 --- ParallelTerminationStrategy: PID 6710 died... 04:08:30.251433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6710): Terminated: ok {rc=0} 04:08:30.334621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:08:31.507615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:31.520369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:31.595494 tst iperf3m4.py: using LAC 38441 04:08:31.726247 tst iperf3m4.py: using RAC 191 04:08:31.898077 tst iperf3m4.py: using CellId 38441 04:08:32.032176 tst iperf3m4.py: using BVCI 38442 04:08:32.153911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.166080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.178033 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.190140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.203059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.215852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.228755 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.241683 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:32.255675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:32.375931 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:32.498028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:32.615067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:32.734695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:08:32.950510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:33.271905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6712): Launched 04:08:33.550082 run iperf3-srv_10.42.42.10(pid=6713): Launched 04:08:33.672349 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:08:33.887651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:34.209606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6714): Launched 04:08:34.489697 run iperf3-srv_10.42.42.10(pid=6715): Launched 04:08:34.612058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:08:34.827631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:35.150182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6716): Launched 04:08:35.427002 run iperf3-srv_10.42.42.10(pid=6717): Launched 04:08:35.546564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:08:35.760511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:08:36.081464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6718): Launched 04:08:36.359318 run iperf3-srv_10.42.42.10(pid=6719): Launched 04:08:36.480815 tst iperf3m4.py:8: start network... 04:08:36.694917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:37.191951 run create_hlr_db(pid=6720): Launched 04:08:37.313261 bus /gobi_6: Setting Powered False 04:08:38.375892 run create_hlr_db(pid=6720): Terminated: ok {rc=0} 04:08:38.820353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Launched 04:08:39.139587 run osmo-hlr_10.42.42.2(pid=6723): Launched 04:08:39.260670 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:39.815922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Launched 04:08:40.135621 run osmo-stp_10.42.42.5(pid=6726): Launched 04:08:40.256557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:40.805951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Launched 04:08:40.929802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:41.201161 run patchelf(pid=6729): Launched 04:08:41.378333 run osmo-stp_10.42.42.5(pid=6726): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] 04:08:41.513701 run osmo-stp_10.42.42.5(pid=6726): stdout: | (launched: 2022-12-14_04:08:40.076644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:41.650961 run osmo-stp_10.42.42.5(pid=6726): stderr: | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040840265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:41.787626 run osmo-stp_10.42.42.5(pid=6726): stdout: | (launched: 2022-12-14_04:08:40.076644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:41.919051 run osmo-stp_10.42.42.5(pid=6726): stderr: | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040840264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040840265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040840265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:42.074729 run patchelf(pid=6729): Terminating (SIGINT) 04:08:42.253424 run patchelf(pid=6729): Terminated: ok {rc=0} 04:08:42.382011 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6726): Process ended prematurely: osmo-stp_10.42.42.5(pid=6726) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:08:42.392270 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:08:42.421272 run osmo-hlr_10.42.42.2(pid=6723): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6723)] 04:08:42.472533 run osmo-hlr_10.42.42.2(pid=6723): stdout: | (launched: 2022-12-14_04:08:39.081078) 04:08:42.525146 run osmo-hlr_10.42.42.2(pid=6723): stderr: | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040839274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040839287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040839295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040839295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040839295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:42.577989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6712): Terminating (SIGTERM) 04:08:42.620102 run iperf3-srv_10.42.42.10(pid=6713): Terminating (SIGTERM) 04:08:42.662635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6714): Terminating (SIGTERM) 04:08:42.705339 run iperf3-srv_10.42.42.10(pid=6715): Terminating (SIGTERM) 04:08:42.747792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6716): Terminating (SIGTERM) 04:08:42.790465 run iperf3-srv_10.42.42.10(pid=6717): Terminating (SIGTERM) 04:08:42.832841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6718): Terminating (SIGTERM) 04:08:42.875334 run iperf3-srv_10.42.42.10(pid=6719): Terminating (SIGTERM) 04:08:42.917798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Terminating (SIGTERM) 04:08:42.960411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Terminating (SIGTERM) 04:08:43.002510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Terminating (SIGTERM) 04:08:43.044699 --- ParallelTerminationStrategy: PID 6712 died... 04:08:43.065037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6712): Terminated: ok {rc=0} 04:08:43.111684 --- ParallelTerminationStrategy: PID 6713 died... 04:08:43.131526 run iperf3-srv_10.42.42.10(pid=6713): Terminated {rc=256} 04:08:43.178126 --- ParallelTerminationStrategy: PID 6714 died... 04:08:43.198064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6714): Terminated: ok {rc=0} 04:08:43.244657 --- ParallelTerminationStrategy: PID 6715 died... 04:08:43.264532 run iperf3-srv_10.42.42.10(pid=6715): Terminated {rc=256} 04:08:43.310893 --- ParallelTerminationStrategy: PID 6716 died... 04:08:43.330821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6716): Terminated: ok {rc=0} 04:08:43.377290 --- ParallelTerminationStrategy: PID 6717 died... 04:08:43.397177 run iperf3-srv_10.42.42.10(pid=6717): Terminated {rc=256} 04:08:43.443587 --- ParallelTerminationStrategy: PID 6718 died... 04:08:43.463538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6718): Terminated: ok {rc=0} 04:08:43.509908 --- ParallelTerminationStrategy: PID 6719 died... 04:08:43.529799 run iperf3-srv_10.42.42.10(pid=6719): Terminated {rc=256} 04:08:43.576255 --- ParallelTerminationStrategy: PID 6722 died... 04:08:43.596225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6722): Terminated: ok {rc=0} 04:08:43.643030 --- ParallelTerminationStrategy: PID 6725 died... 04:08:43.663108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6725): Terminated: ok {rc=0} 04:08:43.709471 --- ParallelTerminationStrategy: PID 6728 died... 04:08:43.729291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6728): Terminated: ok {rc=0} 04:08:43.817842 bus /gobi_4: Setting Powered False 04:08:44.917763 bus /gobi_4: Setting Powered False 04:08:46.062724 bus /gobi_1: Setting Powered False 04:08:47.176714 bus /gobi_1: Setting Powered False 04:08:48.291303 bus /gobi_0: Setting Powered False 04:08:49.390345 bus /gobi_0: Setting Powered False 04:08:50.507963 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:08:51.610599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:51.622695 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:51.696095 tst ping.py: using LAC 38442 04:08:51.819385 tst ping.py: using RAC 192 04:08:51.941546 tst ping.py: using CellId 38442 04:08:52.056385 tst ping.py: using BVCI 38443 04:08:52.161951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.173408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.184391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.195275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.206094 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.216879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.227859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:52.238675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:08:52.351437 tst ping.py:19: start network... 04:08:52.544471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:08:52.996140 run create_hlr_db(pid=6730): Launched 04:08:53.114487 bus /gobi_6: Setting Powered False 04:08:54.173171 run create_hlr_db(pid=6730): Terminated: ok {rc=0} 04:08:54.602182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Launched 04:08:54.917588 run osmo-hlr_10.42.42.2(pid=6733): Launched 04:08:55.037803 run osmo-stp_10.42.42.5: Starting osmo-stp 04:08:55.583061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Launched 04:08:55.897682 run osmo-stp_10.42.42.5(pid=6736): Launched 04:08:56.017474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:08:56.560780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Launched 04:08:56.681029 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:08:56.945539 run patchelf(pid=6739): Launched 04:08:57.120912 run osmo-stp_10.42.42.5(pid=6736): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] 04:08:57.254673 run osmo-stp_10.42.42.5(pid=6736): stdout: | (launched: 2022-12-14_04:08:55.839949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:57.390467 run osmo-stp_10.42.42.5(pid=6736): stderr: | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040856031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:57.526416 run osmo-stp_10.42.42.5(pid=6736): stdout: | (launched: 2022-12-14_04:08:55.839949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:08:57.655662 run osmo-stp_10.42.42.5(pid=6736): stderr: | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040856030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040856031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040856031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:08:57.808724 run patchelf(pid=6739): Terminating (SIGINT) 04:08:57.985243 run patchelf(pid=6739): Terminated: ok {rc=0} 04:08:58.113017 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=6736): Process ended prematurely: osmo-stp_10.42.42.5(pid=6736) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 04:08:58.122645 tst ping.py:22: Test FAILED (6.5 sec) 04:08:58.150888 run osmo-hlr_10.42.42.2(pid=6733): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6733)] 04:08:58.201803 run osmo-hlr_10.42.42.2(pid=6733): stdout: | (launched: 2022-12-14_04:08:54.859930) 04:08:58.253751 run osmo-hlr_10.42.42.2(pid=6733): stderr: | [0;m[1;31m20221214040855076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040855076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040855076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040855077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040855077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040855077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040855090 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040855098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040855098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040855098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:08:58.305919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Terminating (SIGTERM) 04:08:58.347266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Terminating (SIGTERM) 04:08:58.389746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Terminating (SIGTERM) 04:08:58.431593 --- ParallelTerminationStrategy: PID 6732 died... 04:08:58.451644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6732): Terminated: ok {rc=0} 04:08:58.497608 --- ParallelTerminationStrategy: PID 6735 died... 04:08:58.517110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6735): Terminated: ok {rc=0} 04:08:58.563084 --- ParallelTerminationStrategy: PID 6738 died... 04:08:58.582741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6738): Terminated: ok {rc=0} 04:08:58.669972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:08:59.757187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:08:59.769489 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:08:59.841684 tst ping_idle_ping.py: using LAC 38443 04:08:59.967727 tst ping_idle_ping.py: using RAC 193 04:09:00.091260 tst ping_idle_ping.py: using CellId 38443 04:09:00.214772 tst ping_idle_ping.py: using BVCI 38444 04:09:00.331473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.343238 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.354723 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.366219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.378339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.390561 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.402804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:09:00.414810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:09:00.531009 tst ping_idle_ping.py:24: start network... 04:09:00.726806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:01.216259 run create_hlr_db(pid=6742): Launched 04:09:01.373336 bus /gobi_6: Setting Powered False 04:09:02.459601 run create_hlr_db(pid=6742): Terminated: ok {rc=0} 04:09:02.992118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6892): Launched 04:09:03.356003 run osmo-hlr_10.42.42.2(pid=6940): Launched 04:09:03.572229 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:04.346862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Launched 04:09:04.658941 run osmo-stp_10.42.42.5(pid=7017): Launched 04:09:04.885925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:05.561066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Launched 04:09:05.689079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:05.944107 run patchelf(pid=7020): Launched 04:09:06.124845 run osmo-stp_10.42.42.5(pid=7017): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] 04:09:06.252012 run osmo-stp_10.42.42.5(pid=7017): stdout: | (launched: 2022-12-14_04:09:04.603314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:06.381874 run osmo-stp_10.42.42.5(pid=7017): stderr: | [0;m[38;5;43m20221214040904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040904927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040904927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040904927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040904928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040904928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:06.511840 run osmo-stp_10.42.42.5(pid=7017): stdout: | (launched: 2022-12-14_04:09:04.603314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:06.634747 run osmo-stp_10.42.42.5(pid=7017): stderr: | [0;m[38;5;43m20221214040904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040904927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040904927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040904927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040904928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040904928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:06.782420 run patchelf(pid=7020): Terminating (SIGINT) 04:09:06.952096 run patchelf(pid=7020): Terminated: ok {rc=0} 04:09:07.074482 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7017): Process ended prematurely: osmo-stp_10.42.42.5(pid=7017) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:09:07.084607 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 04:09:07.112830 run osmo-hlr_10.42.42.2(pid=6940): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6940)] 04:09:07.162636 run osmo-hlr_10.42.42.2(pid=6940): stdout: | (launched: 2022-12-14_04:09:03.289720) 04:09:07.213888 run osmo-hlr_10.42.42.2(pid=6940): stderr: | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040903640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040903662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040903675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040903675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040903675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:07.265915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6892): Terminating (SIGTERM) 04:09:07.308181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Terminating (SIGTERM) 04:09:07.352307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Terminating (SIGTERM) 04:09:07.395897 --- ParallelTerminationStrategy: PID 6892 died... 04:09:07.415774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6892): Terminated: ok {rc=0} 04:09:07.462247 --- ParallelTerminationStrategy: PID 7016 died... 04:09:07.483013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7016): Terminated: ok {rc=0} 04:09:07.528317 --- ParallelTerminationStrategy: PID 7019 died... 04:09:07.548064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7019): Terminated: ok {rc=0} 04:09:07.637867 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:09:08.947198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:09:08.954034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:09:08.989537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:09:09.030260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:09:09.118643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:09:09.153016 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:09:09.192323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:09:09.790973 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:09:09.842841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:09.856060 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:09.932518 tst cs_paging_gprs_active.py: using LAC 38444 04:09:10.053379 tst cs_paging_gprs_active.py: using RAC 194 04:09:10.172155 tst cs_paging_gprs_active.py: using CellId 38444 04:09:10.292319 tst cs_paging_gprs_active.py: using BVCI 38445 04:09:10.405376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.417370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.429378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.441134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.454777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.467050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.479387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.491563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:10.504135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:10.627195 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:10.750350 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:09:10.958794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:11.271180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7026): Launched 04:09:11.557074 run iperf3-srv_10.42.42.10(pid=7027): Launched 04:09:11.691587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:09:11.903358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:12.220897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7028): Launched 04:09:12.507666 run iperf3-srv_10.42.42.10(pid=7029): Launched 04:09:12.640541 tst cs_paging_gprs_active.py:38: start network... 04:09:12.854358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:13.337360 run create_hlr_db(pid=7030): Launched 04:09:13.502188 bus /gobi_6: Setting Powered False 04:09:14.563328 run create_hlr_db(pid=7030): Terminated: ok {rc=0} 04:09:15.002376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Launched 04:09:15.328727 run osmo-hlr_10.42.42.2(pid=7033): Launched 04:09:15.570139 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:16.249696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Launched 04:09:16.698593 run osmo-stp_10.42.42.5(pid=7036): Launched 04:09:16.891966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:17.696625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7038): Launched 04:09:17.832385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:18.121248 run patchelf(pid=7039): Launched 04:09:18.436465 run osmo-stp_10.42.42.5(pid=7036): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] 04:09:18.578733 run osmo-stp_10.42.42.5(pid=7036): stdout: | (launched: 2022-12-14_04:09:16.630262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:18.720801 run osmo-stp_10.42.42.5(pid=7036): stderr: | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040916991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:18.863065 run osmo-stp_10.42.42.5(pid=7036): stdout: | (launched: 2022-12-14_04:09:16.630262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:18.998801 run osmo-stp_10.42.42.5(pid=7036): stderr: | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040916990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040916991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040916991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:19.161102 run patchelf(pid=7039): Terminating (SIGINT) 04:09:19.346866 run patchelf(pid=7039): Terminated: ok {rc=0} 04:09:19.481681 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7036): Process ended prematurely: osmo-stp_10.42.42.5(pid=7036) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:09:19.492548 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 04:09:19.522215 run osmo-hlr_10.42.42.2(pid=7033): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7033)] 04:09:19.578126 run osmo-hlr_10.42.42.2(pid=7033): stdout: | (launched: 2022-12-14_04:09:15.271186) 04:09:19.633321 run osmo-hlr_10.42.42.2(pid=7033): stderr: | [0;m[1;31m20221214040915606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040915606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040915606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040915606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040915607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040915607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040915658 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040915672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040915672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040915672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:19.689741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7026): Terminating (SIGTERM) 04:09:19.733815 run iperf3-srv_10.42.42.10(pid=7027): Terminating (SIGTERM) 04:09:19.779015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7028): Terminating (SIGTERM) 04:09:19.824827 run iperf3-srv_10.42.42.10(pid=7029): Terminating (SIGTERM) 04:09:19.873199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Terminating (SIGTERM) 04:09:19.919463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Terminating (SIGTERM) 04:09:19.967174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7038): Terminating (SIGTERM) 04:09:20.015028 --- ParallelTerminationStrategy: PID 7026 died... 04:09:20.037406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7026): Terminated: ok {rc=0} 04:09:20.088456 --- ParallelTerminationStrategy: PID 7027 died... 04:09:20.110314 run iperf3-srv_10.42.42.10(pid=7027): Terminated {rc=256} 04:09:20.159709 --- ParallelTerminationStrategy: PID 7028 died... 04:09:20.181483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7028): Terminated: ok {rc=0} 04:09:20.230761 --- ParallelTerminationStrategy: PID 7029 died... 04:09:20.252247 run iperf3-srv_10.42.42.10(pid=7029): Terminated {rc=256} 04:09:20.301411 --- ParallelTerminationStrategy: PID 7032 died... 04:09:20.322958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7032): Terminated: ok {rc=0} 04:09:20.372166 --- ParallelTerminationStrategy: PID 7035 died... 04:09:20.394312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7035): Terminated: ok {rc=0} 04:09:20.443708 --- ParallelTerminationStrategy: PID 7038 died... 04:09:20.465832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7038): Terminated: ok {rc=0} 04:09:20.558679 bus /gobi_0: Setting Powered False 04:09:21.663670 bus /gobi_0: Setting Powered False 04:09:22.789655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:09:23.945204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:23.957663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:24.034924 tst iperf3.py: using LAC 38445 04:09:24.157365 tst iperf3.py: using RAC 195 04:09:24.281791 tst iperf3.py: using CellId 38445 04:09:24.407112 tst iperf3.py: using BVCI 38446 04:09:24.524577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.536327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.548076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.559772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.571836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.584461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.596736 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.608807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:24.621337 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:24.745294 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:09:24.958083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:25.280189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7041): Launched 04:09:25.563346 run iperf3-srv_10.42.42.10(pid=7042): Launched 04:09:25.687123 tst iperf3.py:8: start network... 04:09:25.905676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:26.411195 run create_hlr_db(pid=7043): Launched 04:09:26.535075 bus /gobi_6: Setting Powered False 04:09:27.595123 run create_hlr_db(pid=7043): Terminated: ok {rc=0} 04:09:28.046496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Launched 04:09:28.374585 run osmo-hlr_10.42.42.2(pid=7046): Launched 04:09:28.500423 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:29.023561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Launched 04:09:29.326481 run osmo-stp_10.42.42.5(pid=7049): Launched 04:09:29.441800 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:29.964568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7051): Launched 04:09:30.080409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:30.337210 run patchelf(pid=7052): Launched 04:09:30.506719 run osmo-stp_10.42.42.5(pid=7049): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] 04:09:30.635007 run osmo-stp_10.42.42.5(pid=7049): stdout: | (launched: 2022-12-14_04:09:29.270368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:30.764648 run osmo-stp_10.42.42.5(pid=7049): stderr: | [0;m[38;5;43m20221214040929440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040929440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040929441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040929441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:30.913446 run osmo-stp_10.42.42.5(pid=7049): stdout: | (launched: 2022-12-14_04:09:29.270368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:31.051028 run osmo-stp_10.42.42.5(pid=7049): stderr: | [0;m[38;5;43m20221214040929440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040929440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040929441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040929441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040929442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:31.215437 run patchelf(pid=7052): Terminating (SIGINT) 04:09:31.402993 run patchelf(pid=7052): Terminated: ok {rc=0} 04:09:31.539227 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7049): Process ended prematurely: osmo-stp_10.42.42.5(pid=7049) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 04:09:31.550818 tst iperf3.py:8: Test FAILED (7.6 sec) 04:09:31.582540 run osmo-hlr_10.42.42.2(pid=7046): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7046)] 04:09:31.637338 run osmo-hlr_10.42.42.2(pid=7046): stdout: | (launched: 2022-12-14_04:09:28.314395) 04:09:31.694453 run osmo-hlr_10.42.42.2(pid=7046): stderr: | [0;m[1;31m20221214040928512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040928512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040928513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040928513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040928513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040928513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040928529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040928537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040928537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040928537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:31.751081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7041): Terminating (SIGTERM) 04:09:31.795009 run iperf3-srv_10.42.42.10(pid=7042): Terminating (SIGTERM) 04:09:31.841035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Terminating (SIGTERM) 04:09:31.887971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Terminating (SIGTERM) 04:09:31.934490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7051): Terminating (SIGTERM) 04:09:31.981501 --- ParallelTerminationStrategy: PID 7041 died... 04:09:32.003393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7041): Terminated: ok {rc=0} 04:09:32.055069 --- ParallelTerminationStrategy: PID 7042 died... 04:09:32.076905 run iperf3-srv_10.42.42.10(pid=7042): Terminated {rc=256} 04:09:32.125991 --- ParallelTerminationStrategy: PID 7045 died... 04:09:32.147675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Terminated: ok {rc=0} 04:09:32.197426 --- ParallelTerminationStrategy: PID 7048 died... 04:09:32.218095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Terminated: ok {rc=0} 04:09:32.266090 --- ParallelTerminationStrategy: PID 7051 died... 04:09:32.286464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7051): Terminated: ok {rc=0} 04:09:32.376772 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:09:33.531087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:33.543144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:33.616284 tst iperf3m4.py: using LAC 38446 04:09:33.745996 tst iperf3m4.py: using RAC 196 04:09:33.873110 tst iperf3m4.py: using CellId 38446 04:09:34.000089 tst iperf3m4.py: using BVCI 38447 04:09:34.118917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.130516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.141876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.153322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.164787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.176367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.188177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.199629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:34.211327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:34.333124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:34.452732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:34.574260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:34.692345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:09:34.895064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:35.198985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7053): Launched 04:09:35.466384 run iperf3-srv_10.42.42.10(pid=7054): Launched 04:09:35.582363 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:09:35.784265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:36.088164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Launched 04:09:36.351140 run iperf3-srv_10.42.42.10(pid=7056): Launched 04:09:36.465793 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:09:36.667727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:36.971475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Launched 04:09:37.237747 run iperf3-srv_10.42.42.10(pid=7058): Launched 04:09:37.351172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:09:37.553698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:09:37.858635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7059): Launched 04:09:38.123820 run iperf3-srv_10.42.42.10(pid=7060): Launched 04:09:38.238540 tst iperf3m4.py:8: start network... 04:09:38.440691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:38.910194 run create_hlr_db(pid=7061): Launched 04:09:39.036323 bus /gobi_6: Setting Powered False 04:09:40.096730 run create_hlr_db(pid=7061): Terminated: ok {rc=0} 04:09:40.519071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Launched 04:09:40.821262 run osmo-hlr_10.42.42.2(pid=7064): Launched 04:09:40.934937 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:41.454100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Launched 04:09:41.755491 run osmo-stp_10.42.42.5(pid=7067): Launched 04:09:41.869878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:42.390995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7069): Launched 04:09:42.506138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:42.762283 run patchelf(pid=7070): Launched 04:09:42.931650 run osmo-stp_10.42.42.5(pid=7067): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] 04:09:43.059212 run osmo-stp_10.42.42.5(pid=7067): stdout: | (launched: 2022-12-14_04:09:41.699121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:43.188661 run osmo-stp_10.42.42.5(pid=7067): stderr: | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040941870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:43.317628 run osmo-stp_10.42.42.5(pid=7067): stdout: | (launched: 2022-12-14_04:09:41.699121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:43.441472 run osmo-stp_10.42.42.5(pid=7067): stderr: | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040941869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040941870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040941870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:43.588564 run patchelf(pid=7070): Terminating (SIGINT) 04:09:43.756771 run patchelf(pid=7070): Terminated: ok {rc=0} 04:09:43.878695 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7067): Process ended prematurely: osmo-stp_10.42.42.5(pid=7067) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:09:43.888368 tst iperf3m4.py:8: Test FAILED (10.4 sec) 04:09:43.916027 run osmo-hlr_10.42.42.2(pid=7064): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7064)] 04:09:43.963942 run osmo-hlr_10.42.42.2(pid=7064): stdout: | (launched: 2022-12-14_04:09:40.765145) 04:09:44.013457 run osmo-hlr_10.42.42.2(pid=7064): stderr: | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040940941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040940953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040940962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040940962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040940962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:44.063418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7053): Terminating (SIGTERM) 04:09:44.103165 run iperf3-srv_10.42.42.10(pid=7054): Terminating (SIGTERM) 04:09:44.142547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Terminating (SIGTERM) 04:09:44.182176 run iperf3-srv_10.42.42.10(pid=7056): Terminating (SIGTERM) 04:09:44.221696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Terminating (SIGTERM) 04:09:44.261353 run iperf3-srv_10.42.42.10(pid=7058): Terminating (SIGTERM) 04:09:44.300771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7059): Terminating (SIGTERM) 04:09:44.340373 run iperf3-srv_10.42.42.10(pid=7060): Terminating (SIGTERM) 04:09:44.379617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Terminating (SIGTERM) 04:09:44.419158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Terminating (SIGTERM) 04:09:44.458973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7069): Terminating (SIGTERM) 04:09:44.499929 --- ParallelTerminationStrategy: PID 7053 died... 04:09:44.519345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7053): Terminated: ok {rc=0} 04:09:44.563689 --- ParallelTerminationStrategy: PID 7054 died... 04:09:44.582388 run iperf3-srv_10.42.42.10(pid=7054): Terminated {rc=256} 04:09:44.626575 --- ParallelTerminationStrategy: PID 7055 died... 04:09:44.645403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7055): Terminated: ok {rc=0} 04:09:44.689592 --- ParallelTerminationStrategy: PID 7056 died... 04:09:44.708237 run iperf3-srv_10.42.42.10(pid=7056): Terminated {rc=256} 04:09:44.751620 --- ParallelTerminationStrategy: PID 7057 died... 04:09:44.770308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7057): Terminated: ok {rc=0} 04:09:44.814308 --- ParallelTerminationStrategy: PID 7058 died... 04:09:44.832887 run iperf3-srv_10.42.42.10(pid=7058): Terminated {rc=256} 04:09:44.876384 --- ParallelTerminationStrategy: PID 7059 died... 04:09:44.894999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7059): Terminated: ok {rc=0} 04:09:44.938861 --- ParallelTerminationStrategy: PID 7060 died... 04:09:44.957562 run iperf3-srv_10.42.42.10(pid=7060): Terminated {rc=256} 04:09:45.001044 --- ParallelTerminationStrategy: PID 7063 died... 04:09:45.019762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7063): Terminated: ok {rc=0} 04:09:45.063377 --- ParallelTerminationStrategy: PID 7066 died... 04:09:45.082133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7066): Terminated: ok {rc=0} 04:09:45.125947 --- ParallelTerminationStrategy: PID 7069 died... 04:09:45.144838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7069): Terminated: ok {rc=0} 04:09:45.231491 bus /gobi_4: Setting Powered False 04:09:46.339413 bus /gobi_4: Setting Powered False 04:09:47.466538 bus /gobi_1: Setting Powered False 04:09:48.565690 bus /gobi_1: Setting Powered False 04:09:49.681739 bus /gobi_0: Setting Powered False 04:09:50.781563 bus /gobi_0: Setting Powered False 04:09:51.899534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:09:53.003806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.015939 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:09:53.089807 tst ping.py: using LAC 38447 04:09:53.215820 tst ping.py: using RAC 197 04:09:53.340377 tst ping.py: using CellId 38447 04:09:53.464465 tst ping.py: using BVCI 38448 04:09:53.580124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.591656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.602898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.614172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.625764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.637307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.648905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:09:53.660486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:09:53.779246 tst ping.py:19: start network... 04:09:53.992415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:09:54.484244 run create_hlr_db(pid=7071): Launched 04:09:54.606286 bus /gobi_6: Setting Powered False 04:09:55.669442 run create_hlr_db(pid=7071): Terminated: ok {rc=0} 04:09:56.094383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7073): Launched 04:09:56.391732 run osmo-hlr_10.42.42.2(pid=7074): Launched 04:09:56.505205 run osmo-stp_10.42.42.5: Starting osmo-stp 04:09:57.042094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7076): Launched 04:09:57.338483 run osmo-stp_10.42.42.5(pid=7077): Launched 04:09:57.452324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:09:57.962370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7079): Launched 04:09:58.074980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:09:58.324757 run patchelf(pid=7080): Launched 04:09:58.489480 run osmo-stp_10.42.42.5(pid=7077): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7077)] 04:09:58.615092 run osmo-stp_10.42.42.5(pid=7077): stdout: | (launched: 2022-12-14_04:09:57.283375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:58.743462 run osmo-stp_10.42.42.5(pid=7077): stderr: | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040957453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040957453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040957453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040957454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:58.871771 run osmo-stp_10.42.42.5(pid=7077): stdout: | (launched: 2022-12-14_04:09:57.283375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:09:58.992441 run osmo-stp_10.42.42.5(pid=7077): stderr: | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214040957452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214040957453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214040957453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214040957453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214040957454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:09:59.136312 run patchelf(pid=7080): Terminating (SIGINT) 04:09:59.302571 run patchelf(pid=7080): Terminated: ok {rc=0} 04:09:59.422301 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7077): Process ended prematurely: osmo-stp_10.42.42.5(pid=7077) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7077)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 04:09:59.431252 tst ping.py:22: Test FAILED (6.4 sec) 04:09:59.458022 run osmo-hlr_10.42.42.2(pid=7074): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7074)] 04:09:59.505727 run osmo-hlr_10.42.42.2(pid=7074): stdout: | (launched: 2022-12-14_04:09:56.336779) 04:09:59.554925 run osmo-hlr_10.42.42.2(pid=7074): stderr: | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214040956513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214040956525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214040956534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214040956534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214040956534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:09:59.604221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7073): Terminating (SIGTERM) 04:09:59.643891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7076): Terminating (SIGTERM) 04:09:59.683945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7079): Terminating (SIGTERM) 04:09:59.724514 --- ParallelTerminationStrategy: PID 7073 died... 04:09:59.743978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7073): Terminated: ok {rc=0} 04:09:59.788419 --- ParallelTerminationStrategy: PID 7076 died... 04:09:59.807223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7076): Terminated: ok {rc=0} 04:09:59.851251 --- ParallelTerminationStrategy: PID 7079 died... 04:09:59.870148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7079): Terminated: ok {rc=0} 04:09:59.956287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:10:01.042854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.055829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:10:01.129582 tst ping_idle_ping.py: using LAC 38448 04:10:01.255951 tst ping_idle_ping.py: using RAC 198 04:10:01.380100 tst ping_idle_ping.py: using CellId 38448 04:10:01.512475 tst ping_idle_ping.py: using BVCI 38449 04:10:01.635919 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.648577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.662089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.677153 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.690672 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.704258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.718073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:10:01.731689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:10:01.900685 tst ping_idle_ping.py:24: start network... 04:10:02.182610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:02.697110 run create_hlr_db(pid=7084): Launched 04:10:02.822104 bus /gobi_6: Setting Powered False 04:10:03.885853 run create_hlr_db(pid=7084): Terminated: ok {rc=0} 04:10:04.314236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Launched 04:10:04.612867 run osmo-hlr_10.42.42.2(pid=7087): Launched 04:10:04.727229 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:05.243085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Launched 04:10:05.541214 run osmo-stp_10.42.42.5(pid=7090): Launched 04:10:05.654295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:06.170946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Launched 04:10:06.286346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:06.537115 run patchelf(pid=7093): Launched 04:10:06.702049 run osmo-stp_10.42.42.5(pid=7090): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] 04:10:06.828522 run osmo-stp_10.42.42.5(pid=7090): stdout: | (launched: 2022-12-14_04:10:05.486018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:06.956252 run osmo-stp_10.42.42.5(pid=7090): stderr: | [0;m[38;5;43m20221214041005656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041005656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041005657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041005657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:07.084166 run osmo-stp_10.42.42.5(pid=7090): stdout: | (launched: 2022-12-14_04:10:05.486018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:07.205932 run osmo-stp_10.42.42.5(pid=7090): stderr: | [0;m[38;5;43m20221214041005656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041005656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041005657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041005657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041005658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:07.350464 run patchelf(pid=7093): Terminating (SIGINT) 04:10:07.517579 run patchelf(pid=7093): Terminated: ok {rc=0} 04:10:07.638041 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7090): Process ended prematurely: osmo-stp_10.42.42.5(pid=7090) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:10:07.646940 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:10:07.673639 run osmo-hlr_10.42.42.2(pid=7087): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7087)] 04:10:07.721103 run osmo-hlr_10.42.42.2(pid=7087): stdout: | (launched: 2022-12-14_04:10:04.557583) 04:10:07.770226 run osmo-hlr_10.42.42.2(pid=7087): stderr: | [0;m[1;31m20221214041004733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041004733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041004733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041004733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041004733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041004734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041004744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041004753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041004753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041004753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:07.819823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminating (SIGTERM) 04:10:07.859296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Terminating (SIGTERM) 04:10:07.898562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Terminating (SIGTERM) 04:10:07.938279 --- ParallelTerminationStrategy: PID 7086 died... 04:10:07.957444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminated: ok {rc=0} 04:10:08.001122 --- ParallelTerminationStrategy: PID 7089 died... 04:10:08.019738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Terminated: ok {rc=0} 04:10:08.063452 --- ParallelTerminationStrategy: PID 7092 died... 04:10:08.082155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Terminated: ok {rc=0} 04:10:08.167845 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:10:09.472046 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:09.479013 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:10:09.512807 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:10:09.547041 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:10:09.598670 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:10:09.632403 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:10:09.666845 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:10:10.226866 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:10:10.231779 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.243109 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:10:10.313959 tst switch_tch_pdch.py: using LAC 38449 04:10:10.438865 tst switch_tch_pdch.py: using RAC 199 04:10:10.562410 tst switch_tch_pdch.py: using CellId 38449 04:10:10.685363 tst switch_tch_pdch.py: using BVCI 38450 04:10:10.801070 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.813446 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.825225 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.837099 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.848917 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.861078 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.873362 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:10:10.885534 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:10:11.002530 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:10:11.123142 tst switch_tch_pdch.py:51: start network... 04:10:11.336832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:11.830922 run create_hlr_db(pid=7098): Launched 04:10:11.953625 bus /gobi_6: Setting Powered False 04:10:13.016863 run create_hlr_db(pid=7098): Terminated: ok {rc=0} 04:10:13.461678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7100): Launched 04:10:13.781672 run osmo-hlr_10.42.42.2(pid=7101): Launched 04:10:13.904318 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:14.422442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7103): Launched 04:10:14.717099 run osmo-stp_10.42.42.5(pid=7104): Launched 04:10:14.829108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:15.341069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7106): Launched 04:10:15.454566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:15.703611 run patchelf(pid=7107): Launched 04:10:15.873293 run osmo-stp_10.42.42.5(pid=7104): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7104)] 04:10:16.021208 run osmo-stp_10.42.42.5(pid=7104): stdout: | (launched: 2022-12-14_04:10:14.662343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:16.163691 run osmo-stp_10.42.42.5(pid=7104): stderr: | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041014832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041014832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041014832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041014833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:16.305431 run osmo-stp_10.42.42.5(pid=7104): stdout: | (launched: 2022-12-14_04:10:14.662343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:16.440171 run osmo-stp_10.42.42.5(pid=7104): stderr: | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041014831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041014832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041014832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041014832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041014833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:16.600819 run patchelf(pid=7107): Terminating (SIGINT) 04:10:16.776590 run patchelf(pid=7107): Terminated: ok {rc=0} 04:10:16.898279 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7104): Process ended prematurely: osmo-stp_10.42.42.5(pid=7104) [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7104)] [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:10:16.907172 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 04:10:16.933954 run osmo-hlr_10.42.42.2(pid=7101): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7101)] 04:10:16.981877 run osmo-hlr_10.42.42.2(pid=7101): stdout: | (launched: 2022-12-14_04:10:13.723188) 04:10:17.031758 run osmo-hlr_10.42.42.2(pid=7101): stderr: | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041013920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041013932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041013940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041013940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041013940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:17.082859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7100): Terminating (SIGTERM) 04:10:17.123635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7103): Terminating (SIGTERM) 04:10:17.165475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7106): Terminating (SIGTERM) 04:10:17.206028 --- ParallelTerminationStrategy: PID 7100 died... 04:10:17.225413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7100): Terminated: ok {rc=0} 04:10:17.270053 --- ParallelTerminationStrategy: PID 7103 died... 04:10:17.288626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7103): Terminated: ok {rc=0} 04:10:17.332032 --- ParallelTerminationStrategy: PID 7106 died... 04:10:17.350597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7106): Terminated: ok {rc=0} 04:10:17.435691 bus /gobi_0: Setting Powered False 04:10:18.535533 bus /gobi_0: Setting Powered False 04:10:19.650772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:10:20.907307 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:20.913059 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:10:20.946830 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:10:20.981158 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:10:21.033943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:10:21.067806 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:10:21.102109 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:10:21.661725 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:10:21.667282 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:21.679040 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:10:21.751208 tst switch_tch_pdch.py: using LAC 38450 04:10:21.877240 tst switch_tch_pdch.py: using RAC 200 04:10:22.001745 tst switch_tch_pdch.py: using CellId 38450 04:10:22.119968 tst switch_tch_pdch.py: using BVCI 38451 04:10:22.229325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.240307 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.251388 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.262341 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.273848 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.285245 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.296657 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:10:22.308058 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:10:22.428005 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:10:22.544679 tst switch_tch_pdch.py:51: start network... 04:10:22.742334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:23.177460 run create_hlr_db(pid=7112): Launched 04:10:23.298457 bus /gobi_6: Setting Powered False 04:10:24.357878 run create_hlr_db(pid=7112): Terminated: ok {rc=0} 04:10:24.765580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7114): Launched 04:10:25.086856 run osmo-hlr_10.42.42.2(pid=7115): Launched 04:10:25.210399 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:25.730322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7117): Launched 04:10:26.049618 run osmo-stp_10.42.42.5(pid=7118): Launched 04:10:26.171202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:10:26.693090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7120): Launched 04:10:26.815867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:10:27.085672 run patchelf(pid=7121): Launched 04:10:27.262751 run osmo-stp_10.42.42.5(pid=7118): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7118)] 04:10:27.397599 run osmo-stp_10.42.42.5(pid=7118): stdout: | (launched: 2022-12-14_04:10:25.990796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:27.534929 run osmo-stp_10.42.42.5(pid=7118): stderr: | [0;m[38;5;43m20221214041026181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041026181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041026182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041026182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041026182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041026183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041026183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:27.671904 run osmo-stp_10.42.42.5(pid=7118): stdout: | (launched: 2022-12-14_04:10:25.990796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:27.802886 run osmo-stp_10.42.42.5(pid=7118): stderr: | [0;m[38;5;43m20221214041026181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041026181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041026182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041026182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041026182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041026183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041026183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:27.957349 run patchelf(pid=7121): Terminating (SIGINT) 04:10:28.135633 run patchelf(pid=7121): Terminated: ok {rc=0} 04:10:28.263984 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7118): Process ended prematurely: osmo-stp_10.42.42.5(pid=7118) [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7118)] [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:10:28.273707 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 04:10:28.301717 run osmo-hlr_10.42.42.2(pid=7115): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7115)] 04:10:28.352664 run osmo-hlr_10.42.42.2(pid=7115): stdout: | (launched: 2022-12-14_04:10:25.028317) 04:10:28.405343 run osmo-hlr_10.42.42.2(pid=7115): stderr: | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041025224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041025236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041025244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041025244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041025244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:28.458272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7114): Terminating (SIGTERM) 04:10:28.499944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7117): Terminating (SIGTERM) 04:10:28.542122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7120): Terminating (SIGTERM) 04:10:28.584811 --- ParallelTerminationStrategy: PID 7114 died... 04:10:28.605328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7114): Terminated: ok {rc=0} 04:10:28.652091 --- ParallelTerminationStrategy: PID 7117 died... 04:10:28.672195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7117): Terminated: ok {rc=0} 04:10:28.718664 --- ParallelTerminationStrategy: PID 7120 died... 04:10:28.738793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7120): Terminated: ok {rc=0} 04:10:28.827506 bus /gobi_0: Setting Powered False 04:10:29.925770 bus /gobi_0: Setting Powered False 04:10:31.055601 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:trx-umtrx --------------------------------------------------------------------- 04:10:32.324320 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:32.328438 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:32.361256 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:10:32.369357 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:10:32.423396 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:32.457970 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:10:32.466250 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:10:33.001059 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:10:33.006447 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:10:33.017899 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:33.070559 tst mo_mt_sms.py: using LAC 38451 04:10:33.197952 tst mo_mt_sms.py: using RAC 201 04:10:33.322201 tst mo_mt_sms.py: using CellId 38451 04:10:33.445832 tst mo_mt_sms.py: using BVCI 38452 04:10:33.560802 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:33.676311 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:33.790493 tst mo_mt_sms.py:9: start nitb and bts... 04:10:33.988717 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:10:34.593226 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7125): Launched 04:10:34.890284 run osmo-nitb_10.42.42.2(pid=7126): Launched 04:10:35.056613 run osmo-nitb_10.42.42.2(pid=7126): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7126)] 04:10:35.190379 run osmo-nitb_10.42.42.2(pid=7126): stdout: | (launched: 2022-12-14_04:10:34.835094) 04:10:35.325169 run osmo-nitb_10.42.42.2(pid=7126): stderr: | (launched: 2022-12-14_04:10:34.879182) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:35.459840 run osmo-nitb_10.42.42.2(pid=7126): stdout: | (launched: 2022-12-14_04:10:34.835094) 04:10:35.588551 run osmo-nitb_10.42.42.2(pid=7126): stderr: | (launched: 2022-12-14_04:10:34.879182) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7126): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7126) [trial-2399↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7126)] 04:10:36.004086 tst osmo-nitb_10.42.42.2(pid=7126): stdout: | (launched: 2022-12-14_04:10:34.835094) 04:10:36.123977 tst osmo-nitb_10.42.42.2(pid=7126): stderr: | (launched: 2022-12-14_04:10:34.879182) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:36.265313 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7126): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7126) [trial-2399↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7126)] [trial-2399↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 04:10:36.273916 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:10:36.280584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7125): Terminating (SIGTERM) 04:10:36.489263 --- ParallelTerminationStrategy: PID 7125 died... 04:10:36.509667 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7125): Terminated: ok {rc=0} 04:10:36.593617 bus /sierra_3: Setting Powered False 04:10:37.692462 bus /sierra_3: Setting Powered False 04:10:38.810737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:trx-umtrx --------------------------------------------------------------------- 04:10:40.007465 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:40.011399 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:40.043578 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:10:40.070020 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 04:10:40.120210 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:40.155818 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:10:40.183516 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 04:10:40.726068 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 04:10:40.731825 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:40.742866 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:40.789095 tst mo_mt_sms.py: using LAC 38452 04:10:40.904485 tst mo_mt_sms.py: using RAC 202 04:10:41.022598 tst mo_mt_sms.py: using CellId 38452 04:10:41.140029 tst mo_mt_sms.py: using BVCI 38453 04:10:41.247476 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:41.258137 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:41.268434 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:41.278855 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:41.289189 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:41.300592 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:41.419941 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 04:10:41.539148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:42.031832 run create_hlr_db(pid=7132): Launched 04:10:42.152850 bus /sierra_2: Setting Powered False 04:10:43.216590 run create_hlr_db(pid=7132): Terminated: ok {rc=0} 04:10:43.641896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7134): Launched 04:10:43.937123 run osmo-hlr_10.42.42.2(pid=7135): Launched 04:10:44.048764 run osmo-stp_10.42.42.5: Starting osmo-stp 04:10:44.577555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7137): Launched 04:10:44.874303 run osmo-stp_10.42.42.5(pid=7138): Launched 04:10:44.988858 run osmo-msc_10.42.42.6: Starting osmo-msc 04:10:45.525853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7140): Launched 04:10:45.821766 run osmo-msc_10.42.42.6(pid=7141): Launched 04:10:46.208494 run osmo-stp_10.42.42.5(pid=7138): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7138)] 04:10:46.468904 run osmo-stp_10.42.42.5(pid=7138): stdout: | (launched: 2022-12-14_04:10:44.818917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:46.599867 run osmo-stp_10.42.42.5(pid=7138): stderr: | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041044990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:46.728113 run osmo-stp_10.42.42.5(pid=7138): stdout: | (launched: 2022-12-14_04:10:44.818917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:10:46.848163 run osmo-stp_10.42.42.5(pid=7138): stderr: | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041044989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041044990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041044990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:10:47.002062 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7138): Process ended prematurely: osmo-stp_10.42.42.5(pid=7138) [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7138)] [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py:16] 04:10:47.015058 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 04:10:47.051082 run osmo-hlr_10.42.42.2(pid=7135): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7135)] 04:10:47.101782 run osmo-hlr_10.42.42.2(pid=7135): stdout: | (launched: 2022-12-14_04:10:43.882282) 04:10:47.153425 run osmo-hlr_10.42.42.2(pid=7135): stderr: | [0;m[1;31m20221214041044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041044057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041044057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041044057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041044057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041044070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041044079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041044079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041044079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:10:47.224903 run osmo-msc_10.42.42.6(pid=7141): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7141)] 04:10:47.274267 run osmo-msc_10.42.42.6(pid=7141): stdout: | (launched: 2022-12-14_04:10:45.766788) 04:10:47.325919 run osmo-msc_10.42.42.6(pid=7141): stderr: | [0;m[38;5;43m20221214041046139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041046139 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc907cd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041046140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041046140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041046140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041046141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041046145 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041046146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041046146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041046146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:10:47.383484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7134): Terminating (SIGTERM) 04:10:47.427881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7137): Terminating (SIGTERM) 04:10:47.472319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7140): Terminating (SIGTERM) 04:10:47.515693 --- ParallelTerminationStrategy: PID 7134 died... 04:10:47.536603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7134): Terminated: ok {rc=0} 04:10:47.583922 --- ParallelTerminationStrategy: PID 7137 died... 04:10:47.604425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7137): Terminated: ok {rc=0} 04:10:47.651438 --- ParallelTerminationStrategy: PID 7140 died... 04:10:47.671956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7140): Terminated: ok {rc=0} 04:10:47.762133 bus /sierra_3: Setting Powered False 04:10:48.861373 bus /sierra_3: Setting Powered False 04:10:49.976917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 04:10:51.212328 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:51.216425 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:51.249491 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 04:10:51.258414 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:10:51.299859 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:51.333471 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 04:10:51.340413 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:10:51.854040 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:10:51.859479 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 04:10:51.870676 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:51.920799 tst assert_extension.py: using LAC 38453 04:10:52.037367 tst assert_extension.py: using RAC 203 04:10:52.153186 tst assert_extension.py: using CellId 38453 04:10:52.266957 tst assert_extension.py: using BVCI 38454 04:10:52.373297 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:10:52.491813 tst assert_extension.py:10: start nitb and bts... 04:10:52.705878 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:10:53.355118 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7149): Launched 04:10:53.674189 run osmo-nitb_10.42.42.2(pid=7150): Launched 04:10:53.851015 run osmo-nitb_10.42.42.2(pid=7150): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7150)] 04:10:53.994678 run osmo-nitb_10.42.42.2(pid=7150): stdout: | (launched: 2022-12-14_04:10:53.615692) 04:10:54.140453 run osmo-nitb_10.42.42.2(pid=7150): stderr: | (launched: 2022-12-14_04:10:53.662879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:54.286138 run osmo-nitb_10.42.42.2(pid=7150): stdout: | (launched: 2022-12-14_04:10:53.615692) 04:10:54.424873 run osmo-nitb_10.42.42.2(pid=7150): stderr: | (launched: 2022-12-14_04:10:53.662879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7150) [trial-2399↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7150)] 04:10:54.794950 tst osmo-nitb_10.42.42.2(pid=7150): stdout: | (launched: 2022-12-14_04:10:53.615692) 04:10:54.924084 tst osmo-nitb_10.42.42.2(pid=7150): stderr: | (launched: 2022-12-14_04:10:53.662879) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:10:55.076436 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7150) [trial-2399↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7150)] [trial-2399↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 04:10:55.085897 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:10:55.093277 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7149): Terminating (SIGTERM) 04:10:55.304407 --- ParallelTerminationStrategy: PID 7149 died... 04:10:55.326194 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7149): Terminated: ok {rc=0} 04:10:55.416312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:trx-umtrx --------------------------------------------------------------------- 04:10:56.594826 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:10:56.599260 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:10:56.632374 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:10:56.661491 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 04:10:56.698578 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:10:56.732929 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:10:56.760808 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 04:10:57.287734 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 04:10:57.293363 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.304355 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 04:10:57.354797 tst assert_extension.py: using LAC 38454 04:10:57.481930 tst assert_extension.py: using RAC 204 04:10:57.609193 tst assert_extension.py: using CellId 38454 04:10:57.735228 tst assert_extension.py: using BVCI 38455 04:10:57.852589 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.863831 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.874973 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.886033 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.897701 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:10:57.909247 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 04:10:58.023498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:10:58.483250 run create_hlr_db(pid=7154): Launched 04:10:58.614086 bus /sierra_2: Setting Powered False 04:10:59.673640 run create_hlr_db(pid=7154): Terminated: ok {rc=0} 04:11:00.118687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7156): Launched 04:11:00.439164 run osmo-hlr_10.42.42.2(pid=7157): Launched 04:11:00.562335 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:01.134359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7159): Launched 04:11:01.481242 run osmo-stp_10.42.42.5(pid=7160): Launched 04:11:01.727548 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:02.395654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7162): Launched 04:11:02.691341 run osmo-msc_10.42.42.6(pid=7163): Launched 04:11:02.855565 run osmo-stp_10.42.42.5(pid=7160): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7160)] 04:11:02.981116 run osmo-stp_10.42.42.5(pid=7160): stdout: | (launched: 2022-12-14_04:11:01.420758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:03.107178 run osmo-stp_10.42.42.5(pid=7160): stderr: | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041101721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:03.231827 run osmo-stp_10.42.42.5(pid=7160): stdout: | (launched: 2022-12-14_04:11:01.420758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:03.350258 run osmo-stp_10.42.42.5(pid=7160): stderr: | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041101720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041101721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041101721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:03.491469 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7160): Process ended prematurely: osmo-stp_10.42.42.5(pid=7160) [trial-2399↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7160)] [trial-2399↪ussd:trx-umtrx↪assert_extension.py:17] 04:11:03.499854 tst assert_extension.py:17: Test FAILED (6.2 sec) 04:11:03.525821 run osmo-hlr_10.42.42.2(pid=7157): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7157)] 04:11:03.573742 run osmo-hlr_10.42.42.2(pid=7157): stdout: | (launched: 2022-12-14_04:11:00.380610) 04:11:03.623280 run osmo-hlr_10.42.42.2(pid=7157): stderr: | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041100577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041100590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041100600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041100600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041100601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:03.692511 run osmo-msc_10.42.42.6(pid=7163): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7163)] 04:11:03.740337 run osmo-msc_10.42.42.6(pid=7163): stdout: | (launched: 2022-12-14_04:11:02.636657) 04:11:03.789795 run osmo-msc_10.42.42.6(pid=7163): stderr: | [0;m[38;5;43m20221214041102909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041102910 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec94c90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041102910 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041102910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041102910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041102910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041102912 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041102912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041102912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041102912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:03.839568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7156): Terminating (SIGTERM) 04:11:03.879466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7159): Terminating (SIGTERM) 04:11:03.918962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7162): Terminating (SIGTERM) 04:11:03.958880 --- ParallelTerminationStrategy: PID 7156 died... 04:11:03.977884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7156): Terminated: ok {rc=0} 04:11:04.021840 --- ParallelTerminationStrategy: PID 7159 died... 04:11:04.040412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7159): Terminated: ok {rc=0} 04:11:04.084088 --- ParallelTerminationStrategy: PID 7162 died... 04:11:04.102676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7162): Terminated: ok {rc=0} 04:11:04.188297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:11:05.417479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:05.425477 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:11:05.459783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:11:05.487684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:11:05.544845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:11:05.578930 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:11:05.607333 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:11:06.150895 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:11:06.200067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.211338 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:11:06.279871 tst mo_mt_call.py: using LAC 38455 04:11:06.405350 tst mo_mt_call.py: using RAC 205 04:11:06.524184 tst mo_mt_call.py: using CellId 38455 04:11:06.652905 tst mo_mt_call.py: using BVCI 38456 04:11:06.771598 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.783413 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.795001 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.806502 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.818767 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:06.830875 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:06.948547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:07.066123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:07.536344 run create_hlr_db(pid=7168): Launched 04:11:07.661024 bus /sierra_2: Setting Powered False 04:11:08.722128 run create_hlr_db(pid=7168): Terminated: ok {rc=0} 04:11:09.145163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Launched 04:11:09.449200 run osmo-hlr_10.42.42.2(pid=7171): Launched 04:11:09.564910 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:10.088533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Launched 04:11:10.390500 run osmo-stp_10.42.42.5(pid=7174): Launched 04:11:10.506136 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:11.056145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Launched 04:11:11.360650 run osmo-msc_10.42.42.6(pid=7177): Launched 04:11:11.530006 run osmo-stp_10.42.42.5(pid=7174): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] 04:11:11.658600 run osmo-stp_10.42.42.5(pid=7174): stdout: | (launched: 2022-12-14_04:11:10.334478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:11.786733 run osmo-stp_10.42.42.5(pid=7174): stderr: | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041110507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:11.913253 run osmo-stp_10.42.42.5(pid=7174): stdout: | (launched: 2022-12-14_04:11:10.334478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:12.033130 run osmo-stp_10.42.42.5(pid=7174): stderr: | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041110506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041110507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041110507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:12.176498 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7174): Process ended prematurely: osmo-stp_10.42.42.5(pid=7174) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:11:12.185553 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:11:12.212016 run osmo-hlr_10.42.42.2(pid=7171): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7171)] 04:11:12.260243 run osmo-hlr_10.42.42.2(pid=7171): stdout: | (launched: 2022-12-14_04:11:09.392771) 04:11:12.310127 run osmo-hlr_10.42.42.2(pid=7171): stderr: | [0;m[1;31m20221214041109569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041109569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041109569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041109569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041109569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041109570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041109582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041109590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041109590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041109590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:12.379464 run osmo-msc_10.42.42.6(pid=7177): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7177)] 04:11:12.427978 run osmo-msc_10.42.42.6(pid=7177): stdout: | (launched: 2022-12-14_04:11:11.304061) 04:11:12.477556 run osmo-msc_10.42.42.6(pid=7177): stderr: | [0;m[38;5;43m20221214041111576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041111577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07c013ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041111577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041111577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041111577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041111577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041111579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041111579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041111579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041111579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:12.527485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Terminating (SIGTERM) 04:11:12.568152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Terminating (SIGTERM) 04:11:12.609050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Terminating (SIGTERM) 04:11:12.649883 --- ParallelTerminationStrategy: PID 7170 died... 04:11:12.668883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7170): Terminated: ok {rc=0} 04:11:12.713309 --- ParallelTerminationStrategy: PID 7173 died... 04:11:12.731822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7173): Terminated: ok {rc=0} 04:11:12.776095 --- ParallelTerminationStrategy: PID 7176 died... 04:11:12.794801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7176): Terminated: ok {rc=0} 04:11:12.880898 bus /sierra_3: Setting Powered False 04:11:13.981435 bus /sierra_3: Setting Powered False 04:11:15.099877 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:11:16.274300 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.289938 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:11:16.374631 tst mo_mt_call_osmux.py: using LAC 38456 04:11:16.494941 tst mo_mt_call_osmux.py: using RAC 206 04:11:16.627538 tst mo_mt_call_osmux.py: using CellId 38456 04:11:16.794453 tst mo_mt_call_osmux.py: using BVCI 38457 04:11:16.919072 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.931880 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.944628 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.957290 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.970924 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:11:16.984406 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:17.127378 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:11:17.244443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:17.715373 run create_hlr_db(pid=7179): Launched 04:11:17.839219 bus /sierra_2: Setting Powered False 04:11:18.899329 run create_hlr_db(pid=7179): Terminated: ok {rc=0} 04:11:19.341770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Launched 04:11:19.666730 run osmo-hlr_10.42.42.2(pid=7182): Launched 04:11:19.792776 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:20.353781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Launched 04:11:20.681102 run osmo-stp_10.42.42.5(pid=7185): Launched 04:11:20.806052 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:21.393914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Launched 04:11:21.718536 run osmo-msc_10.42.42.6(pid=7188): Launched 04:11:21.900408 run osmo-stp_10.42.42.5(pid=7185): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] 04:11:22.037440 run osmo-stp_10.42.42.5(pid=7185): stdout: | (launched: 2022-12-14_04:11:20.620149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:22.175238 run osmo-stp_10.42.42.5(pid=7185): stderr: | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041120814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:22.312120 run osmo-stp_10.42.42.5(pid=7185): stdout: | (launched: 2022-12-14_04:11:20.620149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:22.441121 run osmo-stp_10.42.42.5(pid=7185): stderr: | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041120813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041120814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041120814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:22.595498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7185): Process ended prematurely: osmo-stp_10.42.42.5(pid=7185) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:11:22.605146 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:11:22.632867 run osmo-hlr_10.42.42.2(pid=7182): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7182)] 04:11:22.683519 run osmo-hlr_10.42.42.2(pid=7182): stdout: | (launched: 2022-12-14_04:11:19.607431) 04:11:22.735113 run osmo-hlr_10.42.42.2(pid=7182): stderr: | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041119805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041119818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041119826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041119826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041119826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:22.807316 run osmo-msc_10.42.42.6(pid=7188): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7188)] 04:11:22.856855 run osmo-msc_10.42.42.6(pid=7188): stdout: | (launched: 2022-12-14_04:11:21.658650) 04:11:22.908489 run osmo-msc_10.42.42.6(pid=7188): stderr: | [0;m[38;5;43m20221214041121979 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041121979 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fedbdf79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041121979 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041121979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041121980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041121980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041121982 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041121982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041121982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041121982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:22.960295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Terminating (SIGTERM) 04:11:23.002318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Terminating (SIGTERM) 04:11:23.044636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Terminating (SIGTERM) 04:11:23.087033 --- ParallelTerminationStrategy: PID 7181 died... 04:11:23.107568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7181): Terminated: ok {rc=0} 04:11:23.154153 --- ParallelTerminationStrategy: PID 7184 died... 04:11:23.174060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7184): Terminated: ok {rc=0} 04:11:23.220110 --- ParallelTerminationStrategy: PID 7187 died... 04:11:23.240375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7187): Terminated: ok {rc=0} 04:11:23.328202 bus /sierra_3: Setting Powered False 04:11:24.427550 bus /sierra_3: Setting Powered False 04:11:25.546541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:11:26.800325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:26.807561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:11:26.840504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:11:26.869403 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:11:26.923568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:11:26.958039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:11:26.986247 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:11:27.536614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:11:27.590701 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:27.602279 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:11:27.673206 tst mo_mt_call.py: using LAC 38457 04:11:27.799754 tst mo_mt_call.py: using RAC 207 04:11:27.920490 tst mo_mt_call.py: using CellId 38457 04:11:28.040876 tst mo_mt_call.py: using BVCI 38458 04:11:28.151773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:28.163039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:28.174087 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:28.184840 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:28.195792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:28.206793 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:28.327883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:28.444313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:28.916725 run create_hlr_db(pid=7193): Launched 04:11:29.040638 bus /sierra_2: Setting Powered False 04:11:30.101868 run create_hlr_db(pid=7193): Terminated: ok {rc=0} 04:11:30.545435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7195): Launched 04:11:30.898189 run osmo-hlr_10.42.42.2(pid=7196): Launched 04:11:31.172722 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:31.768129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7198): Launched 04:11:32.101708 run osmo-stp_10.42.42.5(pid=7199): Launched 04:11:32.289454 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:32.879447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7201): Launched 04:11:33.204412 run osmo-msc_10.42.42.6(pid=7202): Launched 04:11:33.385542 run osmo-stp_10.42.42.5(pid=7199): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7199)] 04:11:33.522982 run osmo-stp_10.42.42.5(pid=7199): stdout: | (launched: 2022-12-14_04:11:32.033895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:33.661145 run osmo-stp_10.42.42.5(pid=7199): stderr: | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041132296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:33.798159 run osmo-stp_10.42.42.5(pid=7199): stdout: | (launched: 2022-12-14_04:11:32.033895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:33.927620 run osmo-stp_10.42.42.5(pid=7199): stderr: | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041132295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041132296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041132296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:34.082008 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7199): Process ended prematurely: osmo-stp_10.42.42.5(pid=7199) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7199)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:11:34.091899 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:11:34.120115 run osmo-hlr_10.42.42.2(pid=7196): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7196)] 04:11:34.172014 run osmo-hlr_10.42.42.2(pid=7196): stdout: | (launched: 2022-12-14_04:11:30.811883) 04:11:34.224822 run osmo-hlr_10.42.42.2(pid=7196): stderr: | [0;m[1;31m20221214041131060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041131060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041131065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041131065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041131065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041131065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041131080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041131088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041131089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041131089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:34.298558 run osmo-msc_10.42.42.6(pid=7202): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7202)] 04:11:34.349446 run osmo-msc_10.42.42.6(pid=7202): stdout: | (launched: 2022-12-14_04:11:33.143747) 04:11:34.402199 run osmo-msc_10.42.42.6(pid=7202): stderr: | [0;m[38;5;43m20221214041133466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041133466 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ae1434c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041133466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041133466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041133466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041133466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041133468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041133468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041133469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041133469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:34.454884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7195): Terminating (SIGTERM) 04:11:34.496507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7198): Terminating (SIGTERM) 04:11:34.538981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7201): Terminating (SIGTERM) 04:11:34.581409 --- ParallelTerminationStrategy: PID 7195 died... 04:11:34.602109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7195): Terminated: ok {rc=0} 04:11:34.648997 --- ParallelTerminationStrategy: PID 7198 died... 04:11:34.669155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7198): Terminated: ok {rc=0} 04:11:34.716085 --- ParallelTerminationStrategy: PID 7201 died... 04:11:34.736298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7201): Terminated: ok {rc=0} 04:11:34.825998 bus /sierra_3: Setting Powered False 04:11:35.922657 bus /sierra_3: Setting Powered False 04:11:37.039450 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:11:38.186039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.198356 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:11:38.268310 tst mo_mt_call_osmux.py: using LAC 38458 04:11:38.387572 tst mo_mt_call_osmux.py: using RAC 208 04:11:38.508362 tst mo_mt_call_osmux.py: using CellId 38458 04:11:38.628276 tst mo_mt_call_osmux.py: using BVCI 38459 04:11:38.738896 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.750104 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.760900 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.771768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.782758 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:11:38.793722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:38.908300 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:11:39.033720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:39.540613 run create_hlr_db(pid=7204): Launched 04:11:39.665055 bus /sierra_2: Setting Powered False 04:11:40.729153 run create_hlr_db(pid=7204): Terminated: ok {rc=0} 04:11:41.161368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Launched 04:11:41.465851 run osmo-hlr_10.42.42.2(pid=7207): Launched 04:11:41.583583 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:42.114536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Launched 04:11:42.416379 run osmo-stp_10.42.42.5(pid=7210): Launched 04:11:42.531045 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:43.081403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7212): Launched 04:11:43.385517 run osmo-msc_10.42.42.6(pid=7213): Launched 04:11:43.555439 run osmo-stp_10.42.42.5(pid=7210): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] 04:11:43.683399 run osmo-stp_10.42.42.5(pid=7210): stdout: | (launched: 2022-12-14_04:11:42.360455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:43.811269 run osmo-stp_10.42.42.5(pid=7210): stderr: | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041142533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:43.938211 run osmo-stp_10.42.42.5(pid=7210): stdout: | (launched: 2022-12-14_04:11:42.360455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:44.058933 run osmo-stp_10.42.42.5(pid=7210): stderr: | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041142532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041142533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041142533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:44.203307 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7210): Process ended prematurely: osmo-stp_10.42.42.5(pid=7210) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:11:44.212451 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:11:44.238986 run osmo-hlr_10.42.42.2(pid=7207): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7207)] 04:11:44.286923 run osmo-hlr_10.42.42.2(pid=7207): stdout: | (launched: 2022-12-14_04:11:41.409420) 04:11:44.336550 run osmo-hlr_10.42.42.2(pid=7207): stderr: | [0;m[1;31m20221214041141585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041141585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041141586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041141586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041141586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041141586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041141598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041141609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041141609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041141609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:44.405839 run osmo-msc_10.42.42.6(pid=7213): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7213)] 04:11:44.453666 run osmo-msc_10.42.42.6(pid=7213): stdout: | (launched: 2022-12-14_04:11:43.329054) 04:11:44.502932 run osmo-msc_10.42.42.6(pid=7213): stderr: | [0;m[38;5;43m20221214041143602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041143603 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ccb47dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041143603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041143603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041143603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041143603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041143605 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041143605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041143606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:44.552258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Terminating (SIGTERM) 04:11:44.592180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Terminating (SIGTERM) 04:11:44.631985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7212): Terminating (SIGTERM) 04:11:44.672019 --- ParallelTerminationStrategy: PID 7206 died... 04:11:44.691504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7206): Terminated: ok {rc=0} 04:11:44.735879 --- ParallelTerminationStrategy: PID 7209 died... 04:11:44.754694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7209): Terminated: ok {rc=0} 04:11:44.798650 --- ParallelTerminationStrategy: PID 7212 died... 04:11:44.817614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7212): Terminated: ok {rc=0} 04:11:44.904041 bus /sierra_3: Setting Powered False 04:11:46.004386 bus /sierra_3: Setting Powered False 04:11:47.124887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:11:48.381060 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:11:48.388163 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:11:48.422061 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:11:48.449672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:11:48.506219 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:11:48.540818 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:11:48.568703 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:11:49.112095 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:11:49.160423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.171515 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:11:49.241617 tst mo_mt_call.py: using LAC 38459 04:11:49.358722 tst mo_mt_call.py: using RAC 209 04:11:49.475685 tst mo_mt_call.py: using CellId 38459 04:11:49.593354 tst mo_mt_call.py: using BVCI 38460 04:11:49.703023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.714195 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.725061 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.736011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.747042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:49.757966 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:49.879003 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:49.995197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:11:50.463257 run create_hlr_db(pid=7218): Launched 04:11:50.587093 bus /sierra_2: Setting Powered False 04:11:51.647533 run create_hlr_db(pid=7218): Terminated: ok {rc=0} 04:11:52.068637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Launched 04:11:52.370429 run osmo-hlr_10.42.42.2(pid=7221): Launched 04:11:52.485612 run osmo-stp_10.42.42.5: Starting osmo-stp 04:11:53.005285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Launched 04:11:53.307527 run osmo-stp_10.42.42.5(pid=7224): Launched 04:11:53.422536 run osmo-msc_10.42.42.6: Starting osmo-msc 04:11:53.971065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7226): Launched 04:11:54.275226 run osmo-msc_10.42.42.6(pid=7227): Launched 04:11:54.444742 run osmo-stp_10.42.42.5(pid=7224): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] 04:11:54.572440 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-14_04:11:53.251522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:54.700184 run osmo-stp_10.42.42.5(pid=7224): stderr: | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041153423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:54.826256 run osmo-stp_10.42.42.5(pid=7224): stdout: | (launched: 2022-12-14_04:11:53.251522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:11:54.946411 run osmo-stp_10.42.42.5(pid=7224): stderr: | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041153422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041153423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041153423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:11:55.090218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:11:55.099149 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:11:55.125502 run osmo-hlr_10.42.42.2(pid=7221): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7221)] 04:11:55.172902 run osmo-hlr_10.42.42.2(pid=7221): stdout: | (launched: 2022-12-14_04:11:52.314611) 04:11:55.222118 run osmo-hlr_10.42.42.2(pid=7221): stderr: | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041152489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041152500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041152509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041152509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041152509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:11:55.290835 run osmo-msc_10.42.42.6(pid=7227): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7227)] 04:11:55.338270 run osmo-msc_10.42.42.6(pid=7227): stdout: | (launched: 2022-12-14_04:11:54.218066) 04:11:55.387361 run osmo-msc_10.42.42.6(pid=7227): stderr: | [0;m[38;5;43m20221214041154493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041154493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4492618c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041154493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041154493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041154493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041154493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041154495 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041154495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041154496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041154496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:11:55.436537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminating (SIGTERM) 04:11:55.475680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminating (SIGTERM) 04:11:55.514710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7226): Terminating (SIGTERM) 04:11:55.554183 --- ParallelTerminationStrategy: PID 7220 died... 04:11:55.573442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7220): Terminated: ok {rc=0} 04:11:55.616935 --- ParallelTerminationStrategy: PID 7223 died... 04:11:55.635934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7223): Terminated: ok {rc=0} 04:11:55.679878 --- ParallelTerminationStrategy: PID 7226 died... 04:11:55.698458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7226): Terminated: ok {rc=0} 04:11:55.784093 bus /sierra_3: Setting Powered False 04:11:56.885039 bus /sierra_3: Setting Powered False 04:11:58.002398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:11:59.148887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.160796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:11:59.230909 tst mo_mt_call_osmux.py: using LAC 38460 04:11:59.349090 tst mo_mt_call_osmux.py: using RAC 210 04:11:59.466576 tst mo_mt_call_osmux.py: using CellId 38460 04:11:59.586410 tst mo_mt_call_osmux.py: using BVCI 38461 04:11:59.697741 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.708800 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.719824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.730817 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.741923 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:11:59.752790 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:59.868170 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:11:59.989422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:00.492711 run create_hlr_db(pid=7229): Launched 04:12:00.616300 bus /sierra_2: Setting Powered False 04:12:01.677853 run create_hlr_db(pid=7229): Terminated: ok {rc=0} 04:12:02.115223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7231): Launched 04:12:02.430018 run osmo-hlr_10.42.42.2(pid=7232): Launched 04:12:02.545302 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:03.068931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7234): Launched 04:12:03.373556 run osmo-stp_10.42.42.5(pid=7235): Launched 04:12:03.516746 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:04.067026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7237): Launched 04:12:04.369555 run osmo-msc_10.42.42.6(pid=7238): Launched 04:12:04.538853 run osmo-stp_10.42.42.5(pid=7235): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7235)] 04:12:04.667077 run osmo-stp_10.42.42.5(pid=7235): stdout: | (launched: 2022-12-14_04:12:03.314661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:04.794825 run osmo-stp_10.42.42.5(pid=7235): stderr: | [0;m[38;5;43m20221214041203512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041203513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041203513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041203513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:04.920133 run osmo-stp_10.42.42.5(pid=7235): stdout: | (launched: 2022-12-14_04:12:03.314661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:05.039449 run osmo-stp_10.42.42.5(pid=7235): stderr: | [0;m[38;5;43m20221214041203512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041203513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041203513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041203513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041203514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:05.183030 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7235): Process ended prematurely: osmo-stp_10.42.42.5(pid=7235) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7235)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:12:05.191787 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:12:05.218119 run osmo-hlr_10.42.42.2(pid=7232): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7232)] 04:12:05.265629 run osmo-hlr_10.42.42.2(pid=7232): stdout: | (launched: 2022-12-14_04:12:02.373136) 04:12:05.314860 run osmo-hlr_10.42.42.2(pid=7232): stderr: | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041202552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041202564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041202575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041202575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041202575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:05.383669 run osmo-msc_10.42.42.6(pid=7238): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7238)] 04:12:05.431436 run osmo-msc_10.42.42.6(pid=7238): stdout: | (launched: 2022-12-14_04:12:04.312496) 04:12:05.480434 run osmo-msc_10.42.42.6(pid=7238): stderr: | [0;m[38;5;43m20221214041204586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041204586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99dc070c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041204586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041204586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041204587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041204587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041204588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041204589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041204589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041204589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:05.529787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7231): Terminating (SIGTERM) 04:12:05.569175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7234): Terminating (SIGTERM) 04:12:05.608445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7237): Terminating (SIGTERM) 04:12:05.647888 --- ParallelTerminationStrategy: PID 7231 died... 04:12:05.666995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7231): Terminated: ok {rc=0} 04:12:05.710871 --- ParallelTerminationStrategy: PID 7234 died... 04:12:05.729544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7234): Terminated: ok {rc=0} 04:12:05.772776 --- ParallelTerminationStrategy: PID 7237 died... 04:12:05.791083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7237): Terminated: ok {rc=0} 04:12:05.876308 bus /sierra_3: Setting Powered False 04:12:06.976479 bus /sierra_3: Setting Powered False 04:12:08.091404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:12:09.341440 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:09.348118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:12:09.380365 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:12:09.406961 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:12:09.458423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:12:09.492793 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:12:09.521792 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:12:10.068541 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:12:10.118059 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.129355 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:12:10.196071 tst mo_mt_call.py: using LAC 38461 04:12:10.313179 tst mo_mt_call.py: using RAC 211 04:12:10.429848 tst mo_mt_call.py: using CellId 38461 04:12:10.547607 tst mo_mt_call.py: using BVCI 38462 04:12:10.656887 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.668122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.679012 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.689829 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.700719 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:10.711598 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:10.827256 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:10.949390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:11.455086 run create_hlr_db(pid=7243): Launched 04:12:11.580444 bus /sierra_2: Setting Powered False 04:12:12.644878 run create_hlr_db(pid=7243): Terminated: ok {rc=0} 04:12:13.081740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Launched 04:12:13.409085 run osmo-hlr_10.42.42.2(pid=7246): Launched 04:12:13.533574 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:14.099021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Launched 04:12:14.425717 run osmo-stp_10.42.42.5(pid=7249): Launched 04:12:14.550243 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:15.140171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7251): Launched 04:12:15.467006 run osmo-msc_10.42.42.6(pid=7252): Launched 04:12:15.648895 run osmo-stp_10.42.42.5(pid=7249): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] 04:12:15.786296 run osmo-stp_10.42.42.5(pid=7249): stdout: | (launched: 2022-12-14_04:12:14.365572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:16.001955 run osmo-stp_10.42.42.5(pid=7249): stderr: | [0;m[38;5;43m20221214041214558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041214558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041214559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041214559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:16.157141 run osmo-stp_10.42.42.5(pid=7249): stdout: | (launched: 2022-12-14_04:12:14.365572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:16.289886 run osmo-stp_10.42.42.5(pid=7249): stderr: | [0;m[38;5;43m20221214041214558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041214558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041214559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041214559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041214559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:16.449180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7249): Process ended prematurely: osmo-stp_10.42.42.5(pid=7249) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:12:16.459865 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:12:16.489155 run osmo-hlr_10.42.42.2(pid=7246): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7246)] 04:12:16.544889 run osmo-hlr_10.42.42.2(pid=7246): stdout: | (launched: 2022-12-14_04:12:13.348665) 04:12:16.599720 run osmo-hlr_10.42.42.2(pid=7246): stderr: | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041213547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041213560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041213568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041213568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041213568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:16.676264 run osmo-msc_10.42.42.6(pid=7252): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7252)] 04:12:16.729333 run osmo-msc_10.42.42.6(pid=7252): stdout: | (launched: 2022-12-14_04:12:15.406784) 04:12:16.784508 run osmo-msc_10.42.42.6(pid=7252): stderr: | [0;m[38;5;43m20221214041215727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041215727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd262221c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041215728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041215728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041215728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041215728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041215730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041215730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041215730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041215730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:16.840236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Terminating (SIGTERM) 04:12:16.883779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Terminating (SIGTERM) 04:12:16.928899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7251): Terminating (SIGTERM) 04:12:16.975594 --- ParallelTerminationStrategy: PID 7245 died... 04:12:16.997883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7245): Terminated: ok {rc=0} 04:12:17.047445 --- ParallelTerminationStrategy: PID 7248 died... 04:12:17.070820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7248): Terminated: ok {rc=0} 04:12:17.119869 --- ParallelTerminationStrategy: PID 7251 died... 04:12:17.141849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7251): Terminated: ok {rc=0} 04:12:17.236085 bus /sierra_3: Setting Powered False 04:12:18.337404 bus /sierra_3: Setting Powered False 04:12:19.452076 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:12:20.598780 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:20.610791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:12:20.679920 tst mo_mt_call_osmux.py: using LAC 38462 04:12:20.801814 tst mo_mt_call_osmux.py: using RAC 212 04:12:20.929261 tst mo_mt_call_osmux.py: using CellId 38462 04:12:21.054342 tst mo_mt_call_osmux.py: using BVCI 38463 04:12:21.173076 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:21.184895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:21.196714 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:21.208031 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:21.219688 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:12:21.231237 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:21.349372 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:12:21.470949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:21.943637 run create_hlr_db(pid=7254): Launched 04:12:22.068430 bus /sierra_2: Setting Powered False 04:12:23.129915 run create_hlr_db(pid=7254): Terminated: ok {rc=0} 04:12:23.573974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7256): Launched 04:12:23.899505 run osmo-hlr_10.42.42.2(pid=7257): Launched 04:12:24.023497 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:24.585985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7259): Launched 04:12:24.910949 run osmo-stp_10.42.42.5(pid=7260): Launched 04:12:25.034855 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:25.624731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7262): Launched 04:12:25.950385 run osmo-msc_10.42.42.6(pid=7263): Launched 04:12:26.131046 run osmo-stp_10.42.42.5(pid=7260): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7260)] 04:12:26.268852 run osmo-stp_10.42.42.5(pid=7260): stdout: | (launched: 2022-12-14_04:12:24.850659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:26.407002 run osmo-stp_10.42.42.5(pid=7260): stderr: | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041225044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:26.543961 run osmo-stp_10.42.42.5(pid=7260): stdout: | (launched: 2022-12-14_04:12:24.850659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:26.672896 run osmo-stp_10.42.42.5(pid=7260): stderr: | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041225043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041225044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041225044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:26.827755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7260): Process ended prematurely: osmo-stp_10.42.42.5(pid=7260) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7260)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:12:26.837606 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:12:26.865776 run osmo-hlr_10.42.42.2(pid=7257): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7257)] 04:12:26.917182 run osmo-hlr_10.42.42.2(pid=7257): stdout: | (launched: 2022-12-14_04:12:23.839064) 04:12:26.969948 run osmo-hlr_10.42.42.2(pid=7257): stderr: | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041224037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041224050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041224058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041224058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041224058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:27.043723 run osmo-msc_10.42.42.6(pid=7263): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7263)] 04:12:27.094506 run osmo-msc_10.42.42.6(pid=7263): stdout: | (launched: 2022-12-14_04:12:25.889871) 04:12:27.147248 run osmo-msc_10.42.42.6(pid=7263): stderr: | [0;m[38;5;43m20221214041226211 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041226211 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59f6414c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041226211 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041226211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041226211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041226212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041226213 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041226214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041226214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041226214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:27.201108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7256): Terminating (SIGTERM) 04:12:27.243684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7259): Terminating (SIGTERM) 04:12:27.286863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7262): Terminating (SIGTERM) 04:12:27.329952 --- ParallelTerminationStrategy: PID 7256 died... 04:12:27.350553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7256): Terminated: ok {rc=0} 04:12:27.397665 --- ParallelTerminationStrategy: PID 7259 died... 04:12:27.417771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7259): Terminated: ok {rc=0} 04:12:27.464506 --- ParallelTerminationStrategy: PID 7262 died... 04:12:27.484666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7262): Terminated: ok {rc=0} 04:12:27.573822 bus /sierra_3: Setting Powered False 04:12:28.672434 bus /sierra_3: Setting Powered False 04:12:29.791424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:12:31.064918 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:31.075784 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:12:31.125048 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:12:31.161759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:12:31.234769 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:12:31.283838 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:12:31.320643 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:12:31.840484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:12:31.909555 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:31.924107 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:12:31.998898 tst mo_mt_call.py: using LAC 38463 04:12:32.147220 tst mo_mt_call.py: using RAC 213 04:12:32.295702 tst mo_mt_call.py: using CellId 38463 04:12:32.422662 tst mo_mt_call.py: using BVCI 38464 04:12:32.541416 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:32.552853 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:32.564249 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:32.575546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:32.587303 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:32.599088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:32.717580 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:32.835128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:33.306771 run create_hlr_db(pid=7268): Launched 04:12:33.433465 bus /sierra_2: Setting Powered False 04:12:34.497529 run create_hlr_db(pid=7268): Terminated: ok {rc=0} 04:12:34.949673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Launched 04:12:35.277097 run osmo-hlr_10.42.42.2(pid=7271): Launched 04:12:35.401136 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:35.958723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Launched 04:12:36.285487 run osmo-stp_10.42.42.5(pid=7274): Launched 04:12:36.409645 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:36.997257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7276): Launched 04:12:37.322336 run osmo-msc_10.42.42.6(pid=7277): Launched 04:12:37.503099 run osmo-stp_10.42.42.5(pid=7274): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] 04:12:37.639668 run osmo-stp_10.42.42.5(pid=7274): stdout: | (launched: 2022-12-14_04:12:36.224260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:37.776787 run osmo-stp_10.42.42.5(pid=7274): stderr: | [0;m[38;5;43m20221214041236414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041236415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041236415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041236415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:37.913176 run osmo-stp_10.42.42.5(pid=7274): stdout: | (launched: 2022-12-14_04:12:36.224260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:38.042726 run osmo-stp_10.42.42.5(pid=7274): stderr: | [0;m[38;5;43m20221214041236414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041236415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041236415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041236415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041236416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:38.197242 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7274): Process ended prematurely: osmo-stp_10.42.42.5(pid=7274) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:12:38.207012 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:12:38.235011 run osmo-hlr_10.42.42.2(pid=7271): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7271)] 04:12:38.286494 run osmo-hlr_10.42.42.2(pid=7271): stdout: | (launched: 2022-12-14_04:12:35.216168) 04:12:38.339181 run osmo-hlr_10.42.42.2(pid=7271): stderr: | [0;m[1;31m20221214041235414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041235414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041235415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041235415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041235415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041235415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041235464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041235474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041235474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041235474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:38.412650 run osmo-msc_10.42.42.6(pid=7277): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7277)] 04:12:38.463181 run osmo-msc_10.42.42.6(pid=7277): stdout: | (launched: 2022-12-14_04:12:37.262161) 04:12:38.515620 run osmo-msc_10.42.42.6(pid=7277): stderr: | [0;m[38;5;43m20221214041237588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041237588 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e30f28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041237588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041237588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041237589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041237589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041237590 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041237591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041237591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041237591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:38.568132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Terminating (SIGTERM) 04:12:38.610283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Terminating (SIGTERM) 04:12:38.652317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7276): Terminating (SIGTERM) 04:12:38.694602 --- ParallelTerminationStrategy: PID 7270 died... 04:12:38.715138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7270): Terminated: ok {rc=0} 04:12:38.762031 --- ParallelTerminationStrategy: PID 7273 died... 04:12:38.782078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7273): Terminated: ok {rc=0} 04:12:38.828623 --- ParallelTerminationStrategy: PID 7276 died... 04:12:38.848690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7276): Terminated: ok {rc=0} 04:12:38.937035 bus /sierra_3: Setting Powered False 04:12:40.036041 bus /sierra_3: Setting Powered False 04:12:41.152182 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:12:42.295997 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.308023 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:12:42.380905 tst mo_mt_call_osmux.py: using LAC 38464 04:12:42.500662 tst mo_mt_call_osmux.py: using RAC 214 04:12:42.620297 tst mo_mt_call_osmux.py: using CellId 38464 04:12:42.745588 tst mo_mt_call_osmux.py: using BVCI 38465 04:12:42.856185 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.867395 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.878394 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.889252 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.900217 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:12:42.911155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:43.032310 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:12:43.153494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:43.657771 run create_hlr_db(pid=7279): Launched 04:12:43.784937 bus /sierra_2: Setting Powered False 04:12:44.849245 run create_hlr_db(pid=7279): Terminated: ok {rc=0} 04:12:45.302037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7281): Launched 04:12:45.627537 run osmo-hlr_10.42.42.2(pid=7282): Launched 04:12:45.751643 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:46.348845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7284): Launched 04:12:46.681427 run osmo-stp_10.42.42.5(pid=7285): Launched 04:12:46.830404 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:47.512068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7287): Launched 04:12:47.816231 run osmo-msc_10.42.42.6(pid=7288): Launched 04:12:47.984892 run osmo-stp_10.42.42.5(pid=7285): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7285)] 04:12:48.113370 run osmo-stp_10.42.42.5(pid=7285): stdout: | (launched: 2022-12-14_04:12:46.617835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:48.241182 run osmo-stp_10.42.42.5(pid=7285): stderr: | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041246932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:48.367059 run osmo-stp_10.42.42.5(pid=7285): stdout: | (launched: 2022-12-14_04:12:46.617835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:48.486983 run osmo-stp_10.42.42.5(pid=7285): stderr: | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041246931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041246932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041246932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:48.630734 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7285): Process ended prematurely: osmo-stp_10.42.42.5(pid=7285) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7285)] [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:12:48.639665 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:12:48.666144 run osmo-hlr_10.42.42.2(pid=7282): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7282)] 04:12:48.714046 run osmo-hlr_10.42.42.2(pid=7282): stdout: | (launched: 2022-12-14_04:12:45.567292) 04:12:48.763490 run osmo-hlr_10.42.42.2(pid=7282): stderr: | [0;m[1;31m20221214041245765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041245766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041245766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041245766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041245766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041245766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041245780 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041245788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041245788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041245789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:48.832661 run osmo-msc_10.42.42.6(pid=7288): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7288)] 04:12:48.880462 run osmo-msc_10.42.42.6(pid=7288): stdout: | (launched: 2022-12-14_04:12:47.758951) 04:12:48.929637 run osmo-msc_10.42.42.6(pid=7288): stderr: | [0;m[38;5;43m20221214041248032 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041248032 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffbb8abdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041248032 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041248032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041248032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041248032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041248034 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041248034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041248035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041248035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:12:48.979113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7281): Terminating (SIGTERM) 04:12:49.018694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7284): Terminating (SIGTERM) 04:12:49.058240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7287): Terminating (SIGTERM) 04:12:49.098276 --- ParallelTerminationStrategy: PID 7281 died... 04:12:49.117834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7281): Terminated: ok {rc=0} 04:12:49.162198 --- ParallelTerminationStrategy: PID 7284 died... 04:12:49.181440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7284): Terminated: ok {rc=0} 04:12:49.225634 --- ParallelTerminationStrategy: PID 7287 died... 04:12:49.244410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7287): Terminated: ok {rc=0} 04:12:49.328418 bus /sierra_3: Setting Powered False 04:12:50.427573 bus /sierra_3: Setting Powered False 04:12:51.543770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:12:52.798511 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:12:52.805092 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:12:52.837082 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:12:52.863613 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:12:52.920723 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:12:52.953484 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:12:52.979564 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:12:53.524642 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:12:53.572763 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:53.583970 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:12:53.651511 tst mo_mt_call.py: using LAC 38465 04:12:53.770832 tst mo_mt_call.py: using RAC 215 04:12:53.887660 tst mo_mt_call.py: using CellId 38465 04:12:54.005154 tst mo_mt_call.py: using BVCI 38466 04:12:54.114967 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:54.126198 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:54.137260 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:54.148194 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:54.159212 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:12:54.170192 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:54.290236 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:12:54.407789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:12:54.876438 run create_hlr_db(pid=7293): Launched 04:12:55.000217 bus /sierra_2: Setting Powered False 04:12:56.061070 run create_hlr_db(pid=7293): Terminated: ok {rc=0} 04:12:56.506251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Launched 04:12:56.832773 run osmo-hlr_10.42.42.2(pid=7296): Launched 04:12:56.956805 run osmo-stp_10.42.42.5: Starting osmo-stp 04:12:57.518051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Launched 04:12:57.842973 run osmo-stp_10.42.42.5(pid=7299): Launched 04:12:57.966699 run osmo-msc_10.42.42.6: Starting osmo-msc 04:12:58.558020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Launched 04:12:58.883210 run osmo-msc_10.42.42.6(pid=7302): Launched 04:12:59.064195 run osmo-stp_10.42.42.5(pid=7299): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] 04:12:59.202641 run osmo-stp_10.42.42.5(pid=7299): stdout: | (launched: 2022-12-14_04:12:57.782949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:59.341937 run osmo-stp_10.42.42.5(pid=7299): stderr: | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041257978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:59.478687 run osmo-stp_10.42.42.5(pid=7299): stdout: | (launched: 2022-12-14_04:12:57.782949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:12:59.607915 run osmo-stp_10.42.42.5(pid=7299): stderr: | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041257977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041257978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041257978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:12:59.762324 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7299): Process ended prematurely: osmo-stp_10.42.42.5(pid=7299) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:12:59.771793 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:12:59.799835 run osmo-hlr_10.42.42.2(pid=7296): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7296)] 04:12:59.850805 run osmo-hlr_10.42.42.2(pid=7296): stdout: | (launched: 2022-12-14_04:12:56.772316) 04:12:59.903566 run osmo-hlr_10.42.42.2(pid=7296): stderr: | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041256971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041256983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041256991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041256992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041256992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:12:59.976810 run osmo-msc_10.42.42.6(pid=7302): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7302)] 04:13:00.027130 run osmo-msc_10.42.42.6(pid=7302): stdout: | (launched: 2022-12-14_04:12:58.822707) 04:13:00.079774 run osmo-msc_10.42.42.6(pid=7302): stderr: | [0;m[38;5;43m20221214041259143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041259143 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e5ccb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041259143 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041259143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041259143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041259143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041259145 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041259146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:00.132184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Terminating (SIGTERM) 04:13:00.175083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Terminating (SIGTERM) 04:13:00.218693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Terminating (SIGTERM) 04:13:00.261706 --- ParallelTerminationStrategy: PID 7295 died... 04:13:00.282195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7295): Terminated: ok {rc=0} 04:13:00.328878 --- ParallelTerminationStrategy: PID 7298 died... 04:13:00.348915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7298): Terminated: ok {rc=0} 04:13:00.395543 --- ParallelTerminationStrategy: PID 7301 died... 04:13:00.415724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7301): Terminated: ok {rc=0} 04:13:00.504905 bus /sierra_3: Setting Powered False 04:13:01.606403 bus /sierra_3: Setting Powered False 04:13:02.721111 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:13:03.871146 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:03.883701 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:13:03.956657 tst mo_mt_call_osmux.py: using LAC 38466 04:13:04.085377 tst mo_mt_call_osmux.py: using RAC 216 04:13:04.211895 tst mo_mt_call_osmux.py: using CellId 38466 04:13:04.341392 tst mo_mt_call_osmux.py: using BVCI 38467 04:13:04.459179 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:04.471008 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:04.482685 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:04.494232 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:04.506200 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:13:04.518155 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:04.635075 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:13:04.756463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:05.261553 run create_hlr_db(pid=7304): Launched 04:13:05.385781 bus /sierra_2: Setting Powered False 04:13:06.450013 run create_hlr_db(pid=7304): Terminated: ok {rc=0} 04:13:06.885352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7306): Launched 04:13:07.191017 run osmo-hlr_10.42.42.2(pid=7307): Launched 04:13:07.305677 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:07.826202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7309): Launched 04:13:08.128921 run osmo-stp_10.42.42.5(pid=7310): Launched 04:13:08.244677 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:08.791525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7312): Launched 04:13:09.094089 run osmo-msc_10.42.42.6(pid=7313): Launched 04:13:09.262470 run osmo-stp_10.42.42.5(pid=7310): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7310)] 04:13:09.391025 run osmo-stp_10.42.42.5(pid=7310): stdout: | (launched: 2022-12-14_04:13:08.072026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:09.519045 run osmo-stp_10.42.42.5(pid=7310): stderr: | [0;m[38;5;43m20221214041308243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041308243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041308244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041308244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:09.645149 run osmo-stp_10.42.42.5(pid=7310): stdout: | (launched: 2022-12-14_04:13:08.072026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:09.765114 run osmo-stp_10.42.42.5(pid=7310): stderr: | [0;m[38;5;43m20221214041308243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041308243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041308244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041308244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041308245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:09.908567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7310): Process ended prematurely: osmo-stp_10.42.42.5(pid=7310) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7310)] [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:13:09.917714 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:13:09.944231 run osmo-hlr_10.42.42.2(pid=7307): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7307)] 04:13:09.992313 run osmo-hlr_10.42.42.2(pid=7307): stdout: | (launched: 2022-12-14_04:13:07.133675) 04:13:10.041751 run osmo-hlr_10.42.42.2(pid=7307): stderr: | [0;m[1;31m20221214041307310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041307310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041307310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041307311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041307311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041307311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041307326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041307335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041307335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041307335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:10.111135 run osmo-msc_10.42.42.6(pid=7313): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7313)] 04:13:10.158867 run osmo-msc_10.42.42.6(pid=7313): stdout: | (launched: 2022-12-14_04:13:09.037214) 04:13:10.208219 run osmo-msc_10.42.42.6(pid=7313): stderr: | [0;m[38;5;43m20221214041309310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041309310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00ae087c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041309310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041309310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041309310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041309311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041309312 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041309313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041309313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041309313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:10.258407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7306): Terminating (SIGTERM) 04:13:10.298413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7309): Terminating (SIGTERM) 04:13:10.338584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7312): Terminating (SIGTERM) 04:13:10.378763 --- ParallelTerminationStrategy: PID 7306 died... 04:13:10.398435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7306): Terminated: ok {rc=0} 04:13:10.442872 --- ParallelTerminationStrategy: PID 7309 died... 04:13:10.461712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7309): Terminated: ok {rc=0} 04:13:10.505906 --- ParallelTerminationStrategy: PID 7312 died... 04:13:10.524782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7312): Terminated: ok {rc=0} 04:13:10.609339 bus /sierra_3: Setting Powered False 04:13:11.709451 bus /sierra_3: Setting Powered False 04:13:12.826668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:13:14.078924 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:14.084829 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:13:14.117444 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:13:14.144377 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:13:14.196779 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:13:14.231076 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:13:14.258712 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:13:14.806041 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:13:14.855155 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:14.866327 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:13:14.937568 tst mo_mt_call.py: using LAC 38467 04:13:15.066613 tst mo_mt_call.py: using RAC 217 04:13:15.193932 tst mo_mt_call.py: using CellId 38467 04:13:15.323146 tst mo_mt_call.py: using BVCI 38468 04:13:15.442432 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:15.453787 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:15.464857 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:15.475964 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:15.487535 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:15.499027 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:15.615436 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:15.733518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:16.247326 run create_hlr_db(pid=7318): Launched 04:13:16.406673 bus /sierra_2: Setting Powered False 04:13:17.471636 run create_hlr_db(pid=7318): Terminated: ok {rc=0} 04:13:17.905409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Launched 04:13:18.210030 run osmo-hlr_10.42.42.2(pid=7321): Launched 04:13:18.325170 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:18.847100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Launched 04:13:19.148725 run osmo-stp_10.42.42.5(pid=7324): Launched 04:13:19.263307 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:19.810161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Launched 04:13:20.112805 run osmo-msc_10.42.42.6(pid=7327): Launched 04:13:20.281241 run osmo-stp_10.42.42.5(pid=7324): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] 04:13:20.410124 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-14_04:13:19.091772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:20.538060 run osmo-stp_10.42.42.5(pid=7324): stderr: | [0;m[38;5;43m20221214041319265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041319266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041319266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041319266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:20.663848 run osmo-stp_10.42.42.5(pid=7324): stdout: | (launched: 2022-12-14_04:13:19.091772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:20.783504 run osmo-stp_10.42.42.5(pid=7324): stderr: | [0;m[38;5;43m20221214041319265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041319266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041319266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041319266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041319267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:20.927028 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:13:20.935769 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:13:20.962507 run osmo-hlr_10.42.42.2(pid=7321): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7321)] 04:13:21.010688 run osmo-hlr_10.42.42.2(pid=7321): stdout: | (launched: 2022-12-14_04:13:18.152759) 04:13:21.060410 run osmo-hlr_10.42.42.2(pid=7321): stderr: | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041318330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041318369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041318379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041318379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041318379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:21.130091 run osmo-msc_10.42.42.6(pid=7327): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7327)] 04:13:21.177896 run osmo-msc_10.42.42.6(pid=7327): stdout: | (launched: 2022-12-14_04:13:20.056214) 04:13:21.227395 run osmo-msc_10.42.42.6(pid=7327): stderr: | [0;m[38;5;43m20221214041320330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041320330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc195e5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041320330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041320330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041320330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041320330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041320332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041320333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041320333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041320333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:21.277086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminating (SIGTERM) 04:13:21.316723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminating (SIGTERM) 04:13:21.356116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Terminating (SIGTERM) 04:13:21.395912 --- ParallelTerminationStrategy: PID 7320 died... 04:13:21.415265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7320): Terminated: ok {rc=0} 04:13:21.459205 --- ParallelTerminationStrategy: PID 7323 died... 04:13:21.477905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7323): Terminated: ok {rc=0} 04:13:21.521739 --- ParallelTerminationStrategy: PID 7326 died... 04:13:21.540360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7326): Terminated: ok {rc=0} 04:13:21.625842 bus /sierra_3: Setting Powered False 04:13:22.726412 bus /sierra_3: Setting Powered False 04:13:23.842916 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:13:24.991902 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.004070 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:13:25.076748 tst mo_mt_call_osmux.py: using LAC 38468 04:13:25.203499 tst mo_mt_call_osmux.py: using RAC 218 04:13:25.336503 tst mo_mt_call_osmux.py: using CellId 38468 04:13:25.456277 tst mo_mt_call_osmux.py: using BVCI 38469 04:13:25.566232 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.577411 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.588399 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.599201 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.609929 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:13:25.620688 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:25.736601 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:13:25.854451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:26.323927 run create_hlr_db(pid=7329): Launched 04:13:26.447570 bus /sierra_2: Setting Powered False 04:13:27.507788 run create_hlr_db(pid=7329): Terminated: ok {rc=0} 04:13:27.930741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7331): Launched 04:13:28.233450 run osmo-hlr_10.42.42.2(pid=7332): Launched 04:13:28.348238 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:28.872528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7334): Launched 04:13:29.175459 run osmo-stp_10.42.42.5(pid=7335): Launched 04:13:29.290444 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:29.844863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7337): Launched 04:13:30.149389 run osmo-msc_10.42.42.6(pid=7338): Launched 04:13:30.320051 run osmo-stp_10.42.42.5(pid=7335): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7335)] 04:13:30.449291 run osmo-stp_10.42.42.5(pid=7335): stdout: | (launched: 2022-12-14_04:13:29.118509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:30.577309 run osmo-stp_10.42.42.5(pid=7335): stderr: | [0;m[38;5;43m20221214041329290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041329290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041329291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041329291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:30.703470 run osmo-stp_10.42.42.5(pid=7335): stdout: | (launched: 2022-12-14_04:13:29.118509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:30.823806 run osmo-stp_10.42.42.5(pid=7335): stderr: | [0;m[38;5;43m20221214041329290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041329290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041329291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041329291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041329292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:30.981626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7335): Process ended prematurely: osmo-stp_10.42.42.5(pid=7335) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7335)] [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:13:30.991148 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:13:31.018708 run osmo-hlr_10.42.42.2(pid=7332): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7332)] 04:13:31.067875 run osmo-hlr_10.42.42.2(pid=7332): stdout: | (launched: 2022-12-14_04:13:28.176483) 04:13:31.118487 run osmo-hlr_10.42.42.2(pid=7332): stderr: | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041328354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041328365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041328374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041328374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041328374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:31.188855 run osmo-msc_10.42.42.6(pid=7338): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7338)] 04:13:31.237843 run osmo-msc_10.42.42.6(pid=7338): stdout: | (launched: 2022-12-14_04:13:30.092237) 04:13:31.288455 run osmo-msc_10.42.42.6(pid=7338): stderr: | [0;m[38;5;43m20221214041330364 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041330365 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b48fc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041330365 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041330365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041330365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041330365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041330367 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041330367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041330367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041330367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:31.339484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7331): Terminating (SIGTERM) 04:13:31.380011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7334): Terminating (SIGTERM) 04:13:31.421245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7337): Terminating (SIGTERM) 04:13:31.463960 --- ParallelTerminationStrategy: PID 7331 died... 04:13:31.483563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7331): Terminated: ok {rc=0} 04:13:31.528571 --- ParallelTerminationStrategy: PID 7334 died... 04:13:31.547874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7334): Terminated: ok {rc=0} 04:13:31.592637 --- ParallelTerminationStrategy: PID 7337 died... 04:13:31.612323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7337): Terminated: ok {rc=0} 04:13:31.702518 bus /sierra_3: Setting Powered False 04:13:32.802123 bus /sierra_3: Setting Powered False 04:13:33.918799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:13:35.171713 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:35.179446 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:13:35.211445 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:13:35.237925 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:13:35.289208 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:13:35.321649 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:13:35.347847 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:13:35.900706 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:13:35.949664 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:35.961038 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:13:36.012590 tst mo_mt_call.py: using LAC 38469 04:13:36.133761 tst mo_mt_call.py: using RAC 219 04:13:36.253029 tst mo_mt_call.py: using CellId 38469 04:13:36.371748 tst mo_mt_call.py: using BVCI 38470 04:13:36.483724 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:36.495033 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:36.506332 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:36.517493 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:36.528728 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:36.539892 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:36.659874 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:36.777416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:37.247448 run create_hlr_db(pid=7344): Launched 04:13:37.370348 bus /sierra_2: Setting Powered False 04:13:38.430811 run create_hlr_db(pid=7344): Terminated: ok {rc=0} 04:13:38.852723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Launched 04:13:39.156877 run osmo-hlr_10.42.42.2(pid=7347): Launched 04:13:39.271326 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:39.807435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Launched 04:13:40.110089 run osmo-stp_10.42.42.5(pid=7350): Launched 04:13:40.224473 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:40.770089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Launched 04:13:41.071481 run osmo-msc_10.42.42.6(pid=7353): Launched 04:13:41.239810 run osmo-stp_10.42.42.5(pid=7350): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] 04:13:41.366352 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-14_04:13:40.053084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:41.493330 run osmo-stp_10.42.42.5(pid=7350): stderr: | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041340226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:41.618417 run osmo-stp_10.42.42.5(pid=7350): stdout: | (launched: 2022-12-14_04:13:40.053084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:41.737711 run osmo-stp_10.42.42.5(pid=7350): stderr: | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041340225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041340226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041340226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:41.880678 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:13:41.889836 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:13:41.915966 run osmo-hlr_10.42.42.2(pid=7347): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7347)] 04:13:41.963911 run osmo-hlr_10.42.42.2(pid=7347): stdout: | (launched: 2022-12-14_04:13:39.099763) 04:13:42.013128 run osmo-hlr_10.42.42.2(pid=7347): stderr: | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041339278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041339290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041339299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041339299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041339299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:42.081831 run osmo-msc_10.42.42.6(pid=7353): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7353)] 04:13:42.129045 run osmo-msc_10.42.42.6(pid=7353): stdout: | (launched: 2022-12-14_04:13:41.014750) 04:13:42.177804 run osmo-msc_10.42.42.6(pid=7353): stderr: | [0;m[38;5;43m20221214041341289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041341289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05db24cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041341289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041341289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041341289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041341290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041341291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041341292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041341292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041341292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:42.226929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminating (SIGTERM) 04:13:42.266078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminating (SIGTERM) 04:13:42.305116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Terminating (SIGTERM) 04:13:42.344495 --- ParallelTerminationStrategy: PID 7346 died... 04:13:42.363460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7346): Terminated: ok {rc=0} 04:13:42.406752 --- ParallelTerminationStrategy: PID 7349 died... 04:13:42.425235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7349): Terminated: ok {rc=0} 04:13:42.468405 --- ParallelTerminationStrategy: PID 7352 died... 04:13:42.487240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7352): Terminated: ok {rc=0} 04:13:42.570081 bus /sierra_3: Setting Powered False 04:13:43.667742 bus /sierra_3: Setting Powered False 04:13:44.785016 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:13:45.957666 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:45.971261 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:13:46.032842 tst mo_mt_call_osmux.py: using LAC 38470 04:13:46.163915 tst mo_mt_call_osmux.py: using RAC 220 04:13:46.296089 tst mo_mt_call_osmux.py: using CellId 38470 04:13:46.454550 tst mo_mt_call_osmux.py: using BVCI 38471 04:13:46.581179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.594751 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.607901 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.620897 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.635375 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:13:46.649389 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:46.778699 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:13:46.905889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:47.421925 run create_hlr_db(pid=7355): Launched 04:13:47.548150 bus /sierra_2: Setting Powered False 04:13:48.611812 run create_hlr_db(pid=7355): Terminated: ok {rc=0} 04:13:49.047983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7357): Launched 04:13:49.353462 run osmo-hlr_10.42.42.2(pid=7358): Launched 04:13:49.469807 run osmo-stp_10.42.42.5: Starting osmo-stp 04:13:49.997599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7360): Launched 04:13:50.301823 run osmo-stp_10.42.42.5(pid=7361): Launched 04:13:50.416130 run osmo-msc_10.42.42.6: Starting osmo-msc 04:13:50.965638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7363): Launched 04:13:51.270813 run osmo-msc_10.42.42.6(pid=7364): Launched 04:13:51.440467 run osmo-stp_10.42.42.5(pid=7361): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7361)] 04:13:51.568321 run osmo-stp_10.42.42.5(pid=7361): stdout: | (launched: 2022-12-14_04:13:50.244846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:51.696231 run osmo-stp_10.42.42.5(pid=7361): stderr: | [0;m[38;5;43m20221214041350417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041350417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041350418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041350418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041350418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041350419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041350419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:51.822199 run osmo-stp_10.42.42.5(pid=7361): stdout: | (launched: 2022-12-14_04:13:50.244846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:13:51.942430 run osmo-stp_10.42.42.5(pid=7361): stderr: | [0;m[38;5;43m20221214041350417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041350417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041350418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041350418 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041350418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041350419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041350419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:13:52.086052 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7361): Process ended prematurely: osmo-stp_10.42.42.5(pid=7361) [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7361)] [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:13:52.094918 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:13:52.120891 run osmo-hlr_10.42.42.2(pid=7358): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7358)] 04:13:52.168382 run osmo-hlr_10.42.42.2(pid=7358): stdout: | (launched: 2022-12-14_04:13:49.296235) 04:13:52.217700 run osmo-hlr_10.42.42.2(pid=7358): stderr: | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041349473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041349488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041349497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041349497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041349497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:13:52.287252 run osmo-msc_10.42.42.6(pid=7364): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7364)] 04:13:52.335003 run osmo-msc_10.42.42.6(pid=7364): stdout: | (launched: 2022-12-14_04:13:51.213504) 04:13:52.384230 run osmo-msc_10.42.42.6(pid=7364): stderr: | [0;m[38;5;43m20221214041351486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041351486 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7cd5df3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041351487 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041351487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041351487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041351487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041351489 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041351489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041351489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041351489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:13:52.434104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7357): Terminating (SIGTERM) 04:13:52.473870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7360): Terminating (SIGTERM) 04:13:52.513998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7363): Terminating (SIGTERM) 04:13:52.555121 --- ParallelTerminationStrategy: PID 7357 died... 04:13:52.574464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7357): Terminated: ok {rc=0} 04:13:52.618593 --- ParallelTerminationStrategy: PID 7360 died... 04:13:52.637447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7360): Terminated: ok {rc=0} 04:13:52.681427 --- ParallelTerminationStrategy: PID 7363 died... 04:13:52.700166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7363): Terminated: ok {rc=0} 04:13:52.786721 bus /sierra_3: Setting Powered False 04:13:53.885672 bus /sierra_3: Setting Powered False 04:13:54.998154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:trx-umtrx --------------------------------------------------------------------- 04:13:56.252501 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:13:56.257418 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:13:56.290836 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:13:56.319555 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:13:56.406958 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:13:56.440023 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:13:56.467759 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:13:57.052647 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 04:13:57.058768 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.069967 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:13:57.117728 tst emergency_mo_mt_call.py: using LAC 38471 04:13:57.234292 tst emergency_mo_mt_call.py: using RAC 221 04:13:57.355738 tst emergency_mo_mt_call.py: using CellId 38471 04:13:57.480805 tst emergency_mo_mt_call.py: using BVCI 38472 04:13:57.589517 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.600256 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.610668 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.621244 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.631617 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:13:57.642225 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:57.762095 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:13:57.881564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:13:58.377617 run create_hlr_db(pid=7369): Launched 04:13:58.499122 bus /sierra_2: Setting Powered False 04:13:59.562325 run create_hlr_db(pid=7369): Terminated: ok {rc=0} 04:13:59.989453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Launched 04:14:00.289349 run osmo-hlr_10.42.42.2(pid=7372): Launched 04:14:00.402813 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:00.978599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Launched 04:14:01.305661 run osmo-stp_10.42.42.5(pid=7375): Launched 04:14:01.574079 tst emergency_mo_mt_call.py: using MSISDN 8498 04:14:01.832622 run osmo-msc_10.42.42.6: Starting osmo-msc 04:14:02.382032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Launched 04:14:02.683309 run osmo-msc_10.42.42.6(pid=7378): Launched 04:14:02.849667 run osmo-stp_10.42.42.5(pid=7375): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] 04:14:02.975511 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-14_04:14:01.240052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:03.101814 run osmo-stp_10.42.42.5(pid=7375): stderr: | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041401486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:03.226496 run osmo-stp_10.42.42.5(pid=7375): stdout: | (launched: 2022-12-14_04:14:01.240052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:03.345310 run osmo-stp_10.42.42.5(pid=7375): stderr: | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041401485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041401486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041401486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:03.486682 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 04:14:03.495033 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 04:14:03.521165 run osmo-hlr_10.42.42.2(pid=7372): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7372)] 04:14:03.569791 run osmo-hlr_10.42.42.2(pid=7372): stdout: | (launched: 2022-12-14_04:14:00.232740) 04:14:03.619558 run osmo-hlr_10.42.42.2(pid=7372): stderr: | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041400410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041400420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041400431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041400431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041400431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:03.689091 run osmo-msc_10.42.42.6(pid=7378): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7378)] 04:14:03.737217 run osmo-msc_10.42.42.6(pid=7378): stdout: | (launched: 2022-12-14_04:14:02.625922) 04:14:03.787033 run osmo-msc_10.42.42.6(pid=7378): stderr: | [0;m[38;5;43m20221214041402901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041402901 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a12682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041402901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041402901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041402903 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041402904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041402904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041402904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:14:03.836896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminating (SIGTERM) 04:14:03.876898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminating (SIGTERM) 04:14:03.916793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminating (SIGTERM) 04:14:03.957090 --- ParallelTerminationStrategy: PID 7371 died... 04:14:03.976442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7371): Terminated: ok {rc=0} 04:14:04.020667 --- ParallelTerminationStrategy: PID 7374 died... 04:14:04.039487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7374): Terminated: ok {rc=0} 04:14:04.083341 --- ParallelTerminationStrategy: PID 7377 died... 04:14:04.102073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7377): Terminated: ok {rc=0} 04:14:04.188082 bus /sierra_3: Setting Powered False 04:14:05.287415 bus /sierra_3: Setting Powered False 04:14:06.402841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 04:14:07.491986 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:07.503661 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:07.557937 tst emergency_preemptive_call.py: using LAC 38472 04:14:07.673684 tst emergency_preemptive_call.py: using RAC 222 04:14:07.788826 tst emergency_preemptive_call.py: using CellId 38472 04:14:07.903835 tst emergency_preemptive_call.py: using BVCI 38473 04:14:08.011332 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.022181 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.032652 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.043154 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.053634 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 04:14:08.064067 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.183370 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.300697 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.419546 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:08.535389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:09.034950 run create_hlr_db(pid=7380): Launched 04:14:09.157737 bus /sierra_2: Setting Powered False 04:14:10.220688 run create_hlr_db(pid=7380): Terminated: ok {rc=0} 04:14:10.651371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Launched 04:14:10.951307 run osmo-hlr_10.42.42.2(pid=7383): Launched 04:14:11.064359 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:11.593050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Launched 04:14:11.910198 run osmo-stp_10.42.42.5(pid=7386): Launched 04:14:12.051046 tst emergency_preemptive_call.py: using MSISDN 8499 04:14:12.213832 run osmo-msc_10.42.42.6: Starting osmo-msc 04:14:12.751245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7388): Launched 04:14:13.049266 run osmo-msc_10.42.42.6(pid=7389): Launched 04:14:13.214981 run osmo-stp_10.42.42.5(pid=7386): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] 04:14:13.341217 run osmo-stp_10.42.42.5(pid=7386): stdout: | (launched: 2022-12-14_04:14:11.835834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:13.467483 run osmo-stp_10.42.42.5(pid=7386): stderr: | [0;m[38;5;43m20221214041412035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041412035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041412036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041412036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:13.591843 run osmo-stp_10.42.42.5(pid=7386): stdout: | (launched: 2022-12-14_04:14:11.835834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:13.710234 run osmo-stp_10.42.42.5(pid=7386): stderr: | [0;m[38;5;43m20221214041412035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041412035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041412036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041412036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041412037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:13.851721 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7386): Process ended prematurely: osmo-stp_10.42.42.5(pid=7386) [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 04:14:13.860122 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:14:13.886502 run osmo-hlr_10.42.42.2(pid=7383): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7383)] 04:14:13.934781 run osmo-hlr_10.42.42.2(pid=7383): stdout: | (launched: 2022-12-14_04:14:10.895688) 04:14:13.984345 run osmo-hlr_10.42.42.2(pid=7383): stderr: | [0;m[1;31m20221214041411070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041411070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041411070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041411071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041411071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041411071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041411083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041411092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041411093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041411093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:14.053485 run osmo-msc_10.42.42.6(pid=7389): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7389)] 04:14:14.101171 run osmo-msc_10.42.42.6(pid=7389): stdout: | (launched: 2022-12-14_04:14:12.993345) 04:14:14.150382 run osmo-msc_10.42.42.6(pid=7389): stderr: | [0;m[38;5;43m20221214041413266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041413266 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e03451c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041413266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041413266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041413266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041413266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041413268 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041413269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041413269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041413269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:14:14.200021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Terminating (SIGTERM) 04:14:14.239910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Terminating (SIGTERM) 04:14:14.279658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7388): Terminating (SIGTERM) 04:14:14.319807 --- ParallelTerminationStrategy: PID 7382 died... 04:14:14.338681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7382): Terminated: ok {rc=0} 04:14:14.383297 --- ParallelTerminationStrategy: PID 7385 died... 04:14:14.402168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7385): Terminated: ok {rc=0} 04:14:14.446204 --- ParallelTerminationStrategy: PID 7388 died... 04:14:14.465068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7388): Terminated: ok {rc=0} 04:14:14.550647 bus /sierra_9: Setting Powered False 04:14:15.650513 bus /sierra_9: Setting Powered False 04:14:16.774185 bus /sierra_8: Setting Powered False 04:14:17.879714 bus /sierra_8: Setting Powered False 04:14:18.995864 bus /sierra_3: Setting Powered False 04:14:20.095208 bus /sierra_3: Setting Powered False 04:14:21.209503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx --------------------------------------------------------------------- 04:14:22.484416 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:14:22.488585 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 04:14:22.520620 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 04:14:22.558983 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 04:14:22.645263 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 04:14:22.677524 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 04:14:22.715554 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 04:14:23.305322 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 04:14:23.354239 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.364760 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:23.417534 tst cs_paging_gprs_active.py: using LAC 38473 04:14:23.545105 tst cs_paging_gprs_active.py: using RAC 223 04:14:23.669942 tst cs_paging_gprs_active.py: using CellId 38473 04:14:23.795015 tst cs_paging_gprs_active.py: using BVCI 38474 04:14:23.913264 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.924396 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.935305 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.946203 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.957396 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.968529 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.979921 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:23.991095 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:24.002476 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:24.120520 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:24.239889 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:14:24.460603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:24.788030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7394): Launched 04:14:25.074068 run iperf3-srv_10.42.42.10(pid=7395): Launched 04:14:25.198258 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:14:25.418658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:25.746000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7396): Launched 04:14:26.030107 run iperf3-srv_10.42.42.10(pid=7397): Launched 04:14:26.152106 tst cs_paging_gprs_active.py:38: start network... 04:14:26.372105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:26.879353 run create_hlr_db(pid=7398): Launched 04:14:27.003027 bus /sierra_2: Setting Powered False 04:14:28.067315 run create_hlr_db(pid=7398): Terminated: ok {rc=0} 04:14:28.502571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7400): Launched 04:14:28.807200 run osmo-hlr_10.42.42.2(pid=7401): Launched 04:14:28.922811 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:29.446512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7403): Launched 04:14:29.750084 run osmo-stp_10.42.42.5(pid=7404): Launched 04:14:29.864889 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:30.390601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7406): Launched 04:14:30.505905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:30.762484 run patchelf(pid=7407): Launched 04:14:30.945605 run osmo-stp_10.42.42.5(pid=7404): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7404)] 04:14:31.095783 run osmo-stp_10.42.42.5(pid=7404): stdout: | (launched: 2022-12-14_04:14:29.693333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:31.228078 run osmo-stp_10.42.42.5(pid=7404): stderr: | [0;m[38;5;43m20221214041429863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041429864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041429864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041429864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:31.360769 run osmo-stp_10.42.42.5(pid=7404): stdout: | (launched: 2022-12-14_04:14:29.693333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:31.487355 run osmo-stp_10.42.42.5(pid=7404): stderr: | [0;m[38;5;43m20221214041429863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041429864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041429864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041429864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041429865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:31.638303 run patchelf(pid=7407): Terminating (SIGINT) 04:14:31.811833 run patchelf(pid=7407): Terminated: ok {rc=0} 04:14:31.936930 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7404): Process ended prematurely: osmo-stp_10.42.42.5(pid=7404) [trial-2399↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7404)] [trial-2399↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 04:14:31.947148 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:14:31.975013 run osmo-hlr_10.42.42.2(pid=7401): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7401)] 04:14:32.023490 run osmo-hlr_10.42.42.2(pid=7401): stdout: | (launched: 2022-12-14_04:14:28.750343) 04:14:32.074100 run osmo-hlr_10.42.42.2(pid=7401): stderr: | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041428926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041428938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041428947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041428947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041428947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:32.124751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7394): Terminating (SIGTERM) 04:14:32.166273 run iperf3-srv_10.42.42.10(pid=7395): Terminating (SIGTERM) 04:14:32.209980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7396): Terminating (SIGTERM) 04:14:32.251867 run iperf3-srv_10.42.42.10(pid=7397): Terminating (SIGTERM) 04:14:32.292514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7400): Terminating (SIGTERM) 04:14:32.332396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7403): Terminating (SIGTERM) 04:14:32.372098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7406): Terminating (SIGTERM) 04:14:32.412710 --- ParallelTerminationStrategy: PID 7394 died... 04:14:32.431907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7394): Terminated: ok {rc=0} 04:14:32.475923 --- ParallelTerminationStrategy: PID 7395 died... 04:14:32.494541 run iperf3-srv_10.42.42.10(pid=7395): Terminated {rc=256} 04:14:32.538237 --- ParallelTerminationStrategy: PID 7396 died... 04:14:32.556655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7396): Terminated: ok {rc=0} 04:14:32.600598 --- ParallelTerminationStrategy: PID 7397 died... 04:14:32.619162 run iperf3-srv_10.42.42.10(pid=7397): Terminated {rc=256} 04:14:32.662907 --- ParallelTerminationStrategy: PID 7400 died... 04:14:32.681529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7400): Terminated: ok {rc=0} 04:14:32.725389 --- ParallelTerminationStrategy: PID 7403 died... 04:14:32.743870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7403): Terminated: ok {rc=0} 04:14:32.788082 --- ParallelTerminationStrategy: PID 7406 died... 04:14:32.806912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7406): Terminated: ok {rc=0} 04:14:32.893132 bus /gobi_0: Setting Powered False 04:14:33.993242 bus /gobi_0: Setting Powered False 04:14:35.107928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx iperf3.py ---------------------------------------------- 04:14:36.259032 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.270925 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:36.323805 tst iperf3.py: using LAC 38474 04:14:36.444452 tst iperf3.py: using RAC 224 04:14:36.564421 tst iperf3.py: using CellId 38474 04:14:36.682426 tst iperf3.py: using BVCI 38475 04:14:36.793844 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.804371 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.814934 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.825345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.835588 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.845901 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.856276 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.866704 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:36.877251 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:36.991103 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:37.194228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:37.499685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Launched 04:14:37.764657 run iperf3-srv_10.42.42.10(pid=7409): Launched 04:14:37.878426 tst iperf3.py:8: start network... 04:14:38.080484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:38.552253 run create_hlr_db(pid=7410): Launched 04:14:38.676088 bus /gobi_6: Setting Powered False 04:14:39.737284 run create_hlr_db(pid=7410): Terminated: ok {rc=0} 04:14:40.182227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7412): Launched 04:14:40.510296 run osmo-hlr_10.42.42.2(pid=7413): Launched 04:14:40.635648 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:41.199840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7415): Launched 04:14:41.526279 run osmo-stp_10.42.42.5(pid=7416): Launched 04:14:41.650604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:42.211160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7418): Launched 04:14:42.338231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:42.614603 run patchelf(pid=7419): Launched 04:14:42.795299 run osmo-stp_10.42.42.5(pid=7416): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7416)] 04:14:42.932739 run osmo-stp_10.42.42.5(pid=7416): stdout: | (launched: 2022-12-14_04:14:41.465711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:43.071939 run osmo-stp_10.42.42.5(pid=7416): stderr: | [0;m[38;5;43m20221214041441657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041441657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041441658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041441658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041441658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041441658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041441659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:43.211636 run osmo-stp_10.42.42.5(pid=7416): stdout: | (launched: 2022-12-14_04:14:41.465711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:43.345992 run osmo-stp_10.42.42.5(pid=7416): stderr: | [0;m[38;5;43m20221214041441657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041441657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041441658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041441658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041441658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041441658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041441659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:43.504189 run patchelf(pid=7419): Terminating (SIGINT) 04:14:43.685930 run patchelf(pid=7419): Terminated: ok {rc=0} 04:14:43.816647 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7416): Process ended prematurely: osmo-stp_10.42.42.5(pid=7416) [trial-2399↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7416)] [trial-2399↪gprs:trx-umtrx↪iperf3.py:8] 04:14:43.826968 tst iperf3.py:8: Test FAILED (7.6 sec) 04:14:43.855560 run osmo-hlr_10.42.42.2(pid=7413): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7413)] 04:14:43.906330 run osmo-hlr_10.42.42.2(pid=7413): stdout: | (launched: 2022-12-14_04:14:40.449782) 04:14:43.958200 run osmo-hlr_10.42.42.2(pid=7413): stderr: | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041440647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041440660 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041440670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041440670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041440670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:44.010716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Terminating (SIGTERM) 04:14:44.052710 run iperf3-srv_10.42.42.10(pid=7409): Terminating (SIGTERM) 04:14:44.095225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7412): Terminating (SIGTERM) 04:14:44.137723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7415): Terminating (SIGTERM) 04:14:44.180116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7418): Terminating (SIGTERM) 04:14:44.222547 --- ParallelTerminationStrategy: PID 7408 died... 04:14:44.242923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7408): Terminated: ok {rc=0} 04:14:44.289512 --- ParallelTerminationStrategy: PID 7409 died... 04:14:44.309356 run iperf3-srv_10.42.42.10(pid=7409): Terminated {rc=256} 04:14:44.355471 --- ParallelTerminationStrategy: PID 7412 died... 04:14:44.375312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7412): Terminated: ok {rc=0} 04:14:44.421460 --- ParallelTerminationStrategy: PID 7415 died... 04:14:44.441395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7415): Terminated: ok {rc=0} 04:14:44.487578 --- ParallelTerminationStrategy: PID 7418 died... 04:14:44.507409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7418): Terminated: ok {rc=0} 04:14:44.595524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 04:14:45.744154 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:45.755919 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:14:45.804870 tst iperf3m4.py: using LAC 38475 04:14:45.947062 tst iperf3m4.py: using RAC 225 04:14:46.077106 tst iperf3m4.py: using CellId 38475 04:14:46.214146 tst iperf3m4.py: using BVCI 38476 04:14:46.377864 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.393930 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.408614 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.419714 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.430996 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.442159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.454065 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.465381 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:14:46.476817 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:46.597429 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:46.750234 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:46.872666 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:14:46.999822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:14:47.289052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:47.620788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7421): Launched 04:14:47.906067 run iperf3-srv_10.42.42.10(pid=7422): Launched 04:14:48.028914 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:14:48.248812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:48.578869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7423): Launched 04:14:48.865591 run iperf3-srv_10.42.42.10(pid=7424): Launched 04:14:48.989103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:14:49.209373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:49.539215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7425): Launched 04:14:49.824073 run iperf3-srv_10.42.42.10(pid=7426): Launched 04:14:49.946917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:14:50.166890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:14:50.497398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Launched 04:14:50.783055 run iperf3-srv_10.42.42.10(pid=7428): Launched 04:14:50.905641 tst iperf3m4.py:8: start network... 04:14:51.125199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:14:51.633182 run create_hlr_db(pid=7429): Launched 04:14:51.760184 bus /gobi_6: Setting Powered False 04:14:52.824206 run create_hlr_db(pid=7429): Terminated: ok {rc=0} 04:14:53.279416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Launched 04:14:53.606930 run osmo-hlr_10.42.42.2(pid=7432): Launched 04:14:53.731842 run osmo-stp_10.42.42.5: Starting osmo-stp 04:14:54.297950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Launched 04:14:54.626167 run osmo-stp_10.42.42.5(pid=7435): Launched 04:14:54.751302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:14:55.317101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Launched 04:14:55.442144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:14:55.719820 run patchelf(pid=7438): Launched 04:14:55.901076 run osmo-stp_10.42.42.5(pid=7435): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] 04:14:56.039712 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-14_04:14:54.565193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:56.179859 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041454758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:56.320115 run osmo-stp_10.42.42.5(pid=7435): stdout: | (launched: 2022-12-14_04:14:54.565193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:14:56.454290 run osmo-stp_10.42.42.5(pid=7435): stderr: | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041454757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041454758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041454758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:14:56.613919 run patchelf(pid=7438): Terminating (SIGINT) 04:14:56.796383 run patchelf(pid=7438): Terminated: ok {rc=0} 04:14:56.927531 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2399↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] [trial-2399↪gprs:trx-umtrx↪iperf3m4.py:8] 04:14:56.937839 tst iperf3m4.py:8: Test FAILED (11.2 sec) 04:14:56.966704 run osmo-hlr_10.42.42.2(pid=7432): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7432)] 04:14:57.017502 run osmo-hlr_10.42.42.2(pid=7432): stdout: | (launched: 2022-12-14_04:14:53.545895) 04:14:57.069860 run osmo-hlr_10.42.42.2(pid=7432): stderr: | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041453745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041453758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041453766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041453767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041453767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:14:57.122561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7421): Terminating (SIGTERM) 04:14:57.164685 run iperf3-srv_10.42.42.10(pid=7422): Terminating (SIGTERM) 04:14:57.206792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7423): Terminating (SIGTERM) 04:14:57.249041 run iperf3-srv_10.42.42.10(pid=7424): Terminating (SIGTERM) 04:14:57.291383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7425): Terminating (SIGTERM) 04:14:57.334273 run iperf3-srv_10.42.42.10(pid=7426): Terminating (SIGTERM) 04:14:57.376801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Terminating (SIGTERM) 04:14:57.418983 run iperf3-srv_10.42.42.10(pid=7428): Terminating (SIGTERM) 04:14:57.461215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminating (SIGTERM) 04:14:57.503382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminating (SIGTERM) 04:14:57.545635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminating (SIGTERM) 04:14:57.588037 --- ParallelTerminationStrategy: PID 7421 died... 04:14:57.608467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7421): Terminated: ok {rc=0} 04:14:57.655106 --- ParallelTerminationStrategy: PID 7422 died... 04:14:57.675011 run iperf3-srv_10.42.42.10(pid=7422): Terminated {rc=256} 04:14:57.721318 --- ParallelTerminationStrategy: PID 7423 died... 04:14:57.740930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7423): Terminated: ok {rc=0} 04:14:57.787614 --- ParallelTerminationStrategy: PID 7424 died... 04:14:57.807504 run iperf3-srv_10.42.42.10(pid=7424): Terminated {rc=256} 04:14:57.853926 --- ParallelTerminationStrategy: PID 7425 died... 04:14:57.873825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7425): Terminated: ok {rc=0} 04:14:57.920281 --- ParallelTerminationStrategy: PID 7426 died... 04:14:57.939866 run iperf3-srv_10.42.42.10(pid=7426): Terminated {rc=256} 04:14:57.986322 --- ParallelTerminationStrategy: PID 7427 died... 04:14:58.006292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7427): Terminated: ok {rc=0} 04:14:58.052694 --- ParallelTerminationStrategy: PID 7428 died... 04:14:58.072650 run iperf3-srv_10.42.42.10(pid=7428): Terminated {rc=256} 04:14:58.118978 --- ParallelTerminationStrategy: PID 7431 died... 04:14:58.139054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7431): Terminated: ok {rc=0} 04:14:58.185639 --- ParallelTerminationStrategy: PID 7434 died... 04:14:58.205684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7434): Terminated: ok {rc=0} 04:14:58.252273 --- ParallelTerminationStrategy: PID 7437 died... 04:14:58.272559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7437): Terminated: ok {rc=0} 04:14:58.361880 bus /gobi_4: Setting Powered False 04:14:59.460498 bus /gobi_4: Setting Powered False 04:15:00.579500 bus /gobi_1: Setting Powered False 04:15:01.689064 bus /gobi_1: Setting Powered False 04:15:02.824570 bus /gobi_0: Setting Powered False 04:15:03.923713 bus /gobi_0: Setting Powered False 04:15:05.039607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx ping.py ---------------------------------------------- 04:15:06.143867 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.155450 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:15:06.205192 tst ping.py: using LAC 38476 04:15:06.322733 tst ping.py: using RAC 226 04:15:06.441322 tst ping.py: using CellId 38476 04:15:06.557411 tst ping.py: using BVCI 38477 04:15:06.667184 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.677810 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.688328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.698752 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.709081 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.719378 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.729844 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:06.740247 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:15:06.853862 tst ping.py:19: start network... 04:15:07.052424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:07.515447 run create_hlr_db(pid=7442): Launched 04:15:07.636319 bus /gobi_6: Setting Powered False 04:15:08.696613 run create_hlr_db(pid=7442): Terminated: ok {rc=0} 04:15:09.121102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Launched 04:15:09.420723 run osmo-hlr_10.42.42.2(pid=7445): Launched 04:15:09.533216 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:10.066059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Launched 04:15:10.364206 run osmo-stp_10.42.42.5(pid=7448): Launched 04:15:10.476592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:11.012899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Launched 04:15:11.127317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:11.382279 run patchelf(pid=7451): Launched 04:15:11.547780 run osmo-stp_10.42.42.5(pid=7448): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] 04:15:11.673949 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-14_04:15:10.308464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:11.801769 run osmo-stp_10.42.42.5(pid=7448): stderr: | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041510479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:11.930179 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-14_04:15:10.308464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:12.052058 run osmo-stp_10.42.42.5(pid=7448): stderr: | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041510478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041510479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041510479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:12.196370 run patchelf(pid=7451): Terminating (SIGINT) 04:15:12.362889 run patchelf(pid=7451): Terminated: ok {rc=0} 04:15:12.482975 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2399↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] [trial-2399↪gprs:trx-umtrx↪ping.py:22] 04:15:12.491755 tst ping.py:22: Test FAILED (6.3 sec) 04:15:12.518807 run osmo-hlr_10.42.42.2(pid=7445): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7445)] 04:15:12.566368 run osmo-hlr_10.42.42.2(pid=7445): stdout: | (launched: 2022-12-14_04:15:09.364375) 04:15:12.615731 run osmo-hlr_10.42.42.2(pid=7445): stderr: | [0;m[1;31m20221214041509540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041509540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041509540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041509540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041509540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041509541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041509553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041509562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041509562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041509562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:12.665524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminating (SIGTERM) 04:15:12.705241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminating (SIGTERM) 04:15:12.744894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Terminating (SIGTERM) 04:15:12.785067 --- ParallelTerminationStrategy: PID 7444 died... 04:15:12.804153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminated: ok {rc=0} 04:15:12.848725 --- ParallelTerminationStrategy: PID 7447 died... 04:15:12.867523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminated: ok {rc=0} 04:15:12.911434 --- ParallelTerminationStrategy: PID 7450 died... 04:15:12.930158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7450): Terminated: ok {rc=0} 04:15:13.016325 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 04:15:14.104272 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.115641 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 04:15:14.165540 tst ping_idle_ping.py: using LAC 38477 04:15:14.284019 tst ping_idle_ping.py: using RAC 227 04:15:14.403315 tst ping_idle_ping.py: using CellId 38477 04:15:14.522599 tst ping_idle_ping.py: using BVCI 38478 04:15:14.632433 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.643164 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.653741 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.664138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.674465 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.685271 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.697028 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 04:15:14.708224 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 04:15:14.828099 tst ping_idle_ping.py:24: start network... 04:15:15.044503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:15.545557 run create_hlr_db(pid=7452): Launched 04:15:15.669062 bus /gobi_6: Setting Powered False 04:15:16.729923 run create_hlr_db(pid=7452): Terminated: ok {rc=0} 04:15:17.204580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Launched 04:15:17.517388 run osmo-hlr_10.42.42.2(pid=7455): Launched 04:15:17.633235 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:18.151696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Launched 04:15:18.451778 run osmo-stp_10.42.42.5(pid=7458): Launched 04:15:18.566166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:19.082589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7460): Launched 04:15:19.196503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:19.449684 run patchelf(pid=7461): Launched 04:15:19.615473 run osmo-stp_10.42.42.5(pid=7458): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] 04:15:19.741479 run osmo-stp_10.42.42.5(pid=7458): stdout: | (launched: 2022-12-14_04:15:18.395757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:19.869375 run osmo-stp_10.42.42.5(pid=7458): stderr: | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041518566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:19.997513 run osmo-stp_10.42.42.5(pid=7458): stdout: | (launched: 2022-12-14_04:15:18.395757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:20.119752 run osmo-stp_10.42.42.5(pid=7458): stderr: | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041518566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041518566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041518567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:20.264391 run patchelf(pid=7461): Terminating (SIGINT) 04:15:20.431784 run patchelf(pid=7461): Terminated: ok {rc=0} 04:15:20.551754 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7458): Process ended prematurely: osmo-stp_10.42.42.5(pid=7458) [trial-2399↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] [trial-2399↪gprs:trx-umtrx↪ping_idle_ping.py:27] 04:15:20.560746 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:15:20.587450 run osmo-hlr_10.42.42.2(pid=7455): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7455)] 04:15:20.634882 run osmo-hlr_10.42.42.2(pid=7455): stdout: | (launched: 2022-12-14_04:15:17.460925) 04:15:20.684089 run osmo-hlr_10.42.42.2(pid=7455): stderr: | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041517637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041517649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041517658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041517658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041517658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:20.733787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Terminating (SIGTERM) 04:15:20.773438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Terminating (SIGTERM) 04:15:20.813274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7460): Terminating (SIGTERM) 04:15:20.853670 --- ParallelTerminationStrategy: PID 7454 died... 04:15:20.872821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7454): Terminated: ok {rc=0} 04:15:20.916689 --- ParallelTerminationStrategy: PID 7457 died... 04:15:20.935357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7457): Terminated: ok {rc=0} 04:15:20.978960 --- ParallelTerminationStrategy: PID 7460 died... 04:15:20.997603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7460): Terminated: ok {rc=0} 04:15:21.083309 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 04:15:22.386521 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:15:22.392142 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:15:22.424054 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:15:22.462221 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:15:22.553660 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:15:22.586423 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:15:22.624514 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:15:23.216768 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:15:23.270608 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.282485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:23.331972 tst cs_paging_gprs_active.py: using LAC 38478 04:15:23.459343 tst cs_paging_gprs_active.py: using RAC 228 04:15:23.586693 tst cs_paging_gprs_active.py: using CellId 38478 04:15:23.713568 tst cs_paging_gprs_active.py: using BVCI 38479 04:15:23.826474 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.837408 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.847984 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.858624 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.869116 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.879686 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.890828 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.901829 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:23.912500 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:24.035543 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:24.151547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:15:24.356186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:24.663262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7465): Launched 04:15:24.930246 run iperf3-srv_10.42.42.10(pid=7466): Launched 04:15:25.043744 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:15:25.246784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:25.553660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Launched 04:15:25.819222 run iperf3-srv_10.42.42.10(pid=7468): Launched 04:15:25.932666 tst cs_paging_gprs_active.py:38: start network... 04:15:26.135807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:26.607887 run create_hlr_db(pid=7469): Launched 04:15:26.732200 bus /gobi_6: Setting Powered False 04:15:27.792252 run create_hlr_db(pid=7469): Terminated: ok {rc=0} 04:15:28.239029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7471): Launched 04:15:28.568380 run osmo-hlr_10.42.42.2(pid=7472): Launched 04:15:28.693922 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:29.259411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7474): Launched 04:15:29.587189 run osmo-stp_10.42.42.5(pid=7475): Launched 04:15:29.711607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:30.275779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7477): Launched 04:15:30.401374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:30.678532 run patchelf(pid=7478): Launched 04:15:30.864828 run osmo-stp_10.42.42.5(pid=7475): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7475)] 04:15:31.014225 run osmo-stp_10.42.42.5(pid=7475): stdout: | (launched: 2022-12-14_04:15:29.526451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:31.173314 run osmo-stp_10.42.42.5(pid=7475): stderr: | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041529721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:31.318111 run osmo-stp_10.42.42.5(pid=7475): stdout: | (launched: 2022-12-14_04:15:29.526451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:31.447375 run osmo-stp_10.42.42.5(pid=7475): stderr: | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041529720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041529721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041529721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:31.599992 run patchelf(pid=7478): Terminating (SIGINT) 04:15:31.776521 run patchelf(pid=7478): Terminated: ok {rc=0} 04:15:31.903737 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7475): Process ended prematurely: osmo-stp_10.42.42.5(pid=7475) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7475)] [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:15:31.914237 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:15:31.942677 run osmo-hlr_10.42.42.2(pid=7472): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7472)] 04:15:31.991798 run osmo-hlr_10.42.42.2(pid=7472): stdout: | (launched: 2022-12-14_04:15:28.507562) 04:15:32.042519 run osmo-hlr_10.42.42.2(pid=7472): stderr: | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041528707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041528721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041528729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041528729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041528729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:32.095951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7465): Terminating (SIGTERM) 04:15:32.137347 run iperf3-srv_10.42.42.10(pid=7466): Terminating (SIGTERM) 04:15:32.177976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Terminating (SIGTERM) 04:15:32.219070 run iperf3-srv_10.42.42.10(pid=7468): Terminating (SIGTERM) 04:15:32.259545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7471): Terminating (SIGTERM) 04:15:32.299521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7474): Terminating (SIGTERM) 04:15:32.339530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7477): Terminating (SIGTERM) 04:15:32.380033 --- ParallelTerminationStrategy: PID 7465 died... 04:15:32.398941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7465): Terminated: ok {rc=0} 04:15:32.443028 --- ParallelTerminationStrategy: PID 7466 died... 04:15:32.461690 run iperf3-srv_10.42.42.10(pid=7466): Terminated {rc=256} 04:15:32.505570 --- ParallelTerminationStrategy: PID 7467 died... 04:15:32.524307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7467): Terminated: ok {rc=0} 04:15:32.568070 --- ParallelTerminationStrategy: PID 7468 died... 04:15:32.586908 run iperf3-srv_10.42.42.10(pid=7468): Terminated {rc=256} 04:15:32.630701 --- ParallelTerminationStrategy: PID 7471 died... 04:15:32.649436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7471): Terminated: ok {rc=0} 04:15:32.693531 --- ParallelTerminationStrategy: PID 7474 died... 04:15:32.712174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7474): Terminated: ok {rc=0} 04:15:32.756206 --- ParallelTerminationStrategy: PID 7477 died... 04:15:32.774973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7477): Terminated: ok {rc=0} 04:15:32.859652 bus /gobi_0: Setting Powered False 04:15:33.955904 bus /gobi_0: Setting Powered False 04:15:35.071862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:15:36.221327 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.233370 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:36.290619 tst iperf3.py: using LAC 38479 04:15:36.419278 tst iperf3.py: using RAC 229 04:15:36.546066 tst iperf3.py: using CellId 38479 04:15:36.674585 tst iperf3.py: using BVCI 38480 04:15:36.793915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.805368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.816398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.827488 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.838807 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.850223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.861766 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.873004 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:36.884447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:37.005040 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:37.224346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:37.553265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Launched 04:15:37.837838 run iperf3-srv_10.42.42.10(pid=7480): Launched 04:15:37.960193 tst iperf3.py:8: start network... 04:15:38.180123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:38.687098 run create_hlr_db(pid=7481): Launched 04:15:38.811053 bus /gobi_6: Setting Powered False 04:15:39.874852 run create_hlr_db(pid=7481): Terminated: ok {rc=0} 04:15:40.308364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Launched 04:15:40.612423 run osmo-hlr_10.42.42.2(pid=7484): Launched 04:15:40.727718 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:41.255687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Launched 04:15:41.559941 run osmo-stp_10.42.42.5(pid=7487): Launched 04:15:41.675177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:42.199622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Launched 04:15:42.314873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:42.571489 run patchelf(pid=7490): Launched 04:15:42.740109 run osmo-stp_10.42.42.5(pid=7487): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] 04:15:42.867959 run osmo-stp_10.42.42.5(pid=7487): stdout: | (launched: 2022-12-14_04:15:41.502950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:42.997841 run osmo-stp_10.42.42.5(pid=7487): stderr: | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041541673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:43.127485 run osmo-stp_10.42.42.5(pid=7487): stdout: | (launched: 2022-12-14_04:15:41.502950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:43.251374 run osmo-stp_10.42.42.5(pid=7487): stderr: | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041541673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041541673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041541674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:43.398088 run patchelf(pid=7490): Terminating (SIGINT) 04:15:43.568081 run patchelf(pid=7490): Terminated: ok {rc=0} 04:15:43.690029 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7487): Process ended prematurely: osmo-stp_10.42.42.5(pid=7487) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 04:15:43.699347 tst iperf3.py:8: Test FAILED (7.5 sec) 04:15:43.726902 run osmo-hlr_10.42.42.2(pid=7484): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7484)] 04:15:43.774788 run osmo-hlr_10.42.42.2(pid=7484): stdout: | (launched: 2022-12-14_04:15:40.555368) 04:15:43.824552 run osmo-hlr_10.42.42.2(pid=7484): stderr: | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041540735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041540748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041540758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041540758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041540758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:43.874667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Terminating (SIGTERM) 04:15:43.914151 run iperf3-srv_10.42.42.10(pid=7480): Terminating (SIGTERM) 04:15:43.953493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Terminating (SIGTERM) 04:15:43.992791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Terminating (SIGTERM) 04:15:44.032058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Terminating (SIGTERM) 04:15:44.071722 --- ParallelTerminationStrategy: PID 7479 died... 04:15:44.090951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Terminated: ok {rc=0} 04:15:44.134676 --- ParallelTerminationStrategy: PID 7480 died... 04:15:44.153274 run iperf3-srv_10.42.42.10(pid=7480): Terminated {rc=256} 04:15:44.197006 --- ParallelTerminationStrategy: PID 7483 died... 04:15:44.216035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Terminated: ok {rc=0} 04:15:44.259592 --- ParallelTerminationStrategy: PID 7486 died... 04:15:44.278112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Terminated: ok {rc=0} 04:15:44.321787 --- ParallelTerminationStrategy: PID 7489 died... 04:15:44.340403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Terminated: ok {rc=0} 04:15:44.425760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:15:45.571970 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:45.583464 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:15:45.637141 tst iperf3m4.py: using LAC 38480 04:15:45.755623 tst iperf3m4.py: using RAC 230 04:15:45.890433 tst iperf3m4.py: using CellId 38480 04:15:46.009133 tst iperf3m4.py: using BVCI 38481 04:15:46.156751 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.171759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.186293 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.199926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.213009 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.225127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.239318 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.252920 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:15:46.267258 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:46.428125 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:46.574223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:46.707949 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:15:46.855083 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:15:47.093703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:47.431123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Launched 04:15:47.716029 run iperf3-srv_10.42.42.10(pid=7492): Launched 04:15:47.838547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:15:48.058006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:48.386702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7493): Launched 04:15:48.671617 run iperf3-srv_10.42.42.10(pid=7494): Launched 04:15:48.795344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:15:49.014533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:49.342707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Launched 04:15:49.626982 run iperf3-srv_10.42.42.10(pid=7496): Launched 04:15:49.749734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:15:49.968241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:15:50.295942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7497): Launched 04:15:50.576778 run iperf3-srv_10.42.42.10(pid=7498): Launched 04:15:50.691480 tst iperf3m4.py:8: start network... 04:15:50.893499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:15:51.363657 run create_hlr_db(pid=7499): Launched 04:15:51.486877 bus /gobi_6: Setting Powered False 04:15:52.546920 run create_hlr_db(pid=7499): Terminated: ok {rc=0} 04:15:52.968868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7502): Launched 04:15:53.272510 run osmo-hlr_10.42.42.2(pid=7503): Launched 04:15:53.386937 run osmo-stp_10.42.42.5: Starting osmo-stp 04:15:53.916942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7505): Launched 04:15:54.222164 run osmo-stp_10.42.42.5(pid=7506): Launched 04:15:54.337445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:15:54.862762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7508): Launched 04:15:54.978103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:15:55.235563 run patchelf(pid=7509): Launched 04:15:55.403903 run osmo-stp_10.42.42.5(pid=7506): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7506)] 04:15:55.532897 run osmo-stp_10.42.42.5(pid=7506): stdout: | (launched: 2022-12-14_04:15:54.164897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:55.663079 run osmo-stp_10.42.42.5(pid=7506): stderr: | [0;m[38;5;43m20221214041554334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041554334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041554335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041554335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041554335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041554336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041554336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:55.793454 run osmo-stp_10.42.42.5(pid=7506): stdout: | (launched: 2022-12-14_04:15:54.164897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:15:55.918043 run osmo-stp_10.42.42.5(pid=7506): stderr: | [0;m[38;5;43m20221214041554334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041554334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041554335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041554335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041554335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041554336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041554336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:15:56.066113 run patchelf(pid=7509): Terminating (SIGINT) 04:15:56.236041 run patchelf(pid=7509): Terminated: ok {rc=0} 04:15:56.358484 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7506): Process ended prematurely: osmo-stp_10.42.42.5(pid=7506) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7506)] [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 04:15:56.367929 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:15:56.395306 run osmo-hlr_10.42.42.2(pid=7503): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7503)] 04:15:56.442588 run osmo-hlr_10.42.42.2(pid=7503): stdout: | (launched: 2022-12-14_04:15:53.215563) 04:15:56.491676 run osmo-hlr_10.42.42.2(pid=7503): stderr: | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041553393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041553405 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041553414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041553415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041553415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:15:56.541203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Terminating (SIGTERM) 04:15:56.580345 run iperf3-srv_10.42.42.10(pid=7492): Terminating (SIGTERM) 04:15:56.619311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7493): Terminating (SIGTERM) 04:15:56.658451 run iperf3-srv_10.42.42.10(pid=7494): Terminating (SIGTERM) 04:15:56.697620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Terminating (SIGTERM) 04:15:56.737132 run iperf3-srv_10.42.42.10(pid=7496): Terminating (SIGTERM) 04:15:56.776188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7497): Terminating (SIGTERM) 04:15:56.815471 run iperf3-srv_10.42.42.10(pid=7498): Terminating (SIGTERM) 04:15:56.854571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7502): Terminating (SIGTERM) 04:15:56.893843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7505): Terminating (SIGTERM) 04:15:56.933127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7508): Terminating (SIGTERM) 04:15:56.972749 --- ParallelTerminationStrategy: PID 7491 died... 04:15:56.991898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Terminated: ok {rc=0} 04:15:57.035576 --- ParallelTerminationStrategy: PID 7492 died... 04:15:57.054181 run iperf3-srv_10.42.42.10(pid=7492): Terminated {rc=256} 04:15:57.097802 --- ParallelTerminationStrategy: PID 7493 died... 04:15:57.116458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7493): Terminated: ok {rc=0} 04:15:57.160065 --- ParallelTerminationStrategy: PID 7494 died... 04:15:57.178606 run iperf3-srv_10.42.42.10(pid=7494): Terminated {rc=256} 04:15:57.222104 --- ParallelTerminationStrategy: PID 7495 died... 04:15:57.240827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7495): Terminated: ok {rc=0} 04:15:57.284632 --- ParallelTerminationStrategy: PID 7496 died... 04:15:57.303200 run iperf3-srv_10.42.42.10(pid=7496): Terminated {rc=256} 04:15:57.346766 --- ParallelTerminationStrategy: PID 7497 died... 04:15:57.365359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7497): Terminated: ok {rc=0} 04:15:57.408892 --- ParallelTerminationStrategy: PID 7498 died... 04:15:57.427992 run iperf3-srv_10.42.42.10(pid=7498): Terminated {rc=256} 04:15:57.471498 --- ParallelTerminationStrategy: PID 7502 died... 04:15:57.490385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7502): Terminated: ok {rc=0} 04:15:57.534125 --- ParallelTerminationStrategy: PID 7505 died... 04:15:57.553301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7505): Terminated: ok {rc=0} 04:15:57.597410 --- ParallelTerminationStrategy: PID 7508 died... 04:15:57.616097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7508): Terminated: ok {rc=0} 04:15:57.701396 bus /gobi_4: Setting Powered False 04:15:58.801104 bus /gobi_4: Setting Powered False 04:15:59.915541 bus /gobi_1: Setting Powered False 04:16:01.022319 bus /gobi_1: Setting Powered False 04:16:02.163209 bus /gobi_0: Setting Powered False 04:16:03.264673 bus /gobi_0: Setting Powered False 04:16:04.382420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 04:16:05.485828 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:05.497834 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:16:05.549370 tst ping.py: using LAC 38481 04:16:05.676790 tst ping.py: using RAC 231 04:16:05.805423 tst ping.py: using CellId 38481 04:16:05.930782 tst ping.py: using BVCI 38482 04:16:06.047001 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.058393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.069515 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.080582 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.092007 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.103380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.114926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:06.126326 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:16:06.242708 tst ping.py:19: start network... 04:16:06.441300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:06.903672 run create_hlr_db(pid=7510): Launched 04:16:07.025927 bus /gobi_6: Setting Powered False 04:16:08.086368 run create_hlr_db(pid=7510): Terminated: ok {rc=0} 04:16:08.525244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Launched 04:16:08.846499 run osmo-hlr_10.42.42.2(pid=7513): Launched 04:16:08.970440 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:09.526896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Launched 04:16:09.846694 run osmo-stp_10.42.42.5(pid=7516): Launched 04:16:09.968674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:10.522445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7518): Launched 04:16:10.645261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:10.916582 run patchelf(pid=7519): Launched 04:16:11.094292 run osmo-stp_10.42.42.5(pid=7516): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] 04:16:11.230056 run osmo-stp_10.42.42.5(pid=7516): stdout: | (launched: 2022-12-14_04:16:09.787334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:11.368208 run osmo-stp_10.42.42.5(pid=7516): stderr: | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041609979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:11.505917 run osmo-stp_10.42.42.5(pid=7516): stdout: | (launched: 2022-12-14_04:16:09.787334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:11.637180 run osmo-stp_10.42.42.5(pid=7516): stderr: | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041609978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041609979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041609979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:11.792775 run patchelf(pid=7519): Terminating (SIGINT) 04:16:11.971691 run patchelf(pid=7519): Terminated: ok {rc=0} 04:16:12.100295 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7516): Process ended prematurely: osmo-stp_10.42.42.5(pid=7516) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 04:16:12.109901 tst ping.py:22: Test FAILED (6.6 sec) 04:16:12.138134 run osmo-hlr_10.42.42.2(pid=7513): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7513)] 04:16:12.188675 run osmo-hlr_10.42.42.2(pid=7513): stdout: | (launched: 2022-12-14_04:16:08.786670) 04:16:12.240680 run osmo-hlr_10.42.42.2(pid=7513): stderr: | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041608985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041608997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041609005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041609006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041609006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:12.293153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Terminating (SIGTERM) 04:16:12.335574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Terminating (SIGTERM) 04:16:12.378471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7518): Terminating (SIGTERM) 04:16:12.420722 --- ParallelTerminationStrategy: PID 7512 died... 04:16:12.441212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7512): Terminated: ok {rc=0} 04:16:12.487632 --- ParallelTerminationStrategy: PID 7515 died... 04:16:12.507426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7515): Terminated: ok {rc=0} 04:16:12.553738 --- ParallelTerminationStrategy: PID 7518 died... 04:16:12.573683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7518): Terminated: ok {rc=0} 04:16:12.661534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:16:13.749278 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:13.761668 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:16:13.813205 tst ping_idle_ping.py: using LAC 38482 04:16:13.933011 tst ping_idle_ping.py: using RAC 232 04:16:14.050364 tst ping_idle_ping.py: using CellId 38482 04:16:14.170374 tst ping_idle_ping.py: using BVCI 38483 04:16:14.280261 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.291370 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.301989 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.312487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.323587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.334659 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.346052 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:16:14.357181 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:16:14.472100 tst ping_idle_ping.py:24: start network... 04:16:14.671350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:15.137719 run create_hlr_db(pid=7520): Launched 04:16:15.259957 bus /gobi_6: Setting Powered False 04:16:16.324857 run create_hlr_db(pid=7520): Terminated: ok {rc=0} 04:16:16.812815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7522): Launched 04:16:17.130739 run osmo-hlr_10.42.42.2(pid=7523): Launched 04:16:17.293590 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:17.825036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7525): Launched 04:16:18.125033 run osmo-stp_10.42.42.5(pid=7526): Launched 04:16:18.238367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:18.755693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7528): Launched 04:16:18.869697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:19.123181 run patchelf(pid=7529): Launched 04:16:19.289242 run osmo-stp_10.42.42.5(pid=7526): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7526)] 04:16:19.415952 run osmo-stp_10.42.42.5(pid=7526): stdout: | (launched: 2022-12-14_04:16:18.068276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:19.544274 run osmo-stp_10.42.42.5(pid=7526): stderr: | [0;m[38;5;43m20221214041618239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041618240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041618240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041618240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:19.672714 run osmo-stp_10.42.42.5(pid=7526): stdout: | (launched: 2022-12-14_04:16:18.068276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:19.795706 run osmo-stp_10.42.42.5(pid=7526): stderr: | [0;m[38;5;43m20221214041618239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041618240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041618240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041618240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041618241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:19.940724 run patchelf(pid=7529): Terminating (SIGINT) 04:16:20.107955 run patchelf(pid=7529): Terminated: ok {rc=0} 04:16:20.228332 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7526): Process ended prematurely: osmo-stp_10.42.42.5(pid=7526) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7526)] [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 04:16:20.237265 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:16:20.263948 run osmo-hlr_10.42.42.2(pid=7523): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7523)] 04:16:20.311341 run osmo-hlr_10.42.42.2(pid=7523): stdout: | (launched: 2022-12-14_04:16:17.068832) 04:16:20.360494 run osmo-hlr_10.42.42.2(pid=7523): stderr: | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041617311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041617323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041617331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041617331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041617331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:20.410058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7522): Terminating (SIGTERM) 04:16:20.449295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7525): Terminating (SIGTERM) 04:16:20.488747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7528): Terminating (SIGTERM) 04:16:20.528591 --- ParallelTerminationStrategy: PID 7522 died... 04:16:20.548122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7522): Terminated: ok {rc=0} 04:16:20.592277 --- ParallelTerminationStrategy: PID 7525 died... 04:16:20.610965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7525): Terminated: ok {rc=0} 04:16:20.654963 --- ParallelTerminationStrategy: PID 7528 died... 04:16:20.673951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7528): Terminated: ok {rc=0} 04:16:20.760158 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:16:22.063230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:16:22.069292 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:16:22.101347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:16:22.142841 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:16:22.233319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:16:22.267166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:16:22.307228 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:16:22.901873 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:16:22.955036 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:22.966408 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:23.036845 tst cs_paging_gprs_active.py: using LAC 38483 04:16:23.164548 tst cs_paging_gprs_active.py: using RAC 233 04:16:23.292264 tst cs_paging_gprs_active.py: using CellId 38483 04:16:23.413094 tst cs_paging_gprs_active.py: using BVCI 38484 04:16:23.523792 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.534647 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.545277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.555860 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.566967 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.578205 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.590301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.603420 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:23.614970 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:23.733522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:23.855511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:16:24.076350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:24.405282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7533): Launched 04:16:24.690535 run iperf3-srv_10.42.42.10(pid=7534): Launched 04:16:24.812870 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:16:25.032528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:25.360627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7535): Launched 04:16:25.644847 run iperf3-srv_10.42.42.10(pid=7536): Launched 04:16:25.766673 tst cs_paging_gprs_active.py:38: start network... 04:16:25.986791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:26.494010 run create_hlr_db(pid=7537): Launched 04:16:26.618831 bus /gobi_6: Setting Powered False 04:16:27.679773 run create_hlr_db(pid=7537): Terminated: ok {rc=0} 04:16:28.134498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7539): Launched 04:16:28.462402 run osmo-hlr_10.42.42.2(pid=7540): Launched 04:16:28.589325 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:29.155438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7542): Launched 04:16:29.482224 run osmo-stp_10.42.42.5(pid=7543): Launched 04:16:29.606065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:30.170102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7545): Launched 04:16:30.294859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:30.579668 run patchelf(pid=7546): Launched 04:16:30.762046 run osmo-stp_10.42.42.5(pid=7543): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7543)] 04:16:30.922240 run osmo-stp_10.42.42.5(pid=7543): stdout: | (launched: 2022-12-14_04:16:29.421540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:31.057584 run osmo-stp_10.42.42.5(pid=7543): stderr: | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041629617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:31.194893 run osmo-stp_10.42.42.5(pid=7543): stdout: | (launched: 2022-12-14_04:16:29.421540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:31.325666 run osmo-stp_10.42.42.5(pid=7543): stderr: | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041629616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041629617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041629617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:31.478958 run patchelf(pid=7546): Terminating (SIGINT) 04:16:31.657135 run patchelf(pid=7546): Terminated: ok {rc=0} 04:16:31.787667 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7543): Process ended prematurely: osmo-stp_10.42.42.5(pid=7543) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7543)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:16:31.798021 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:16:31.827679 run osmo-hlr_10.42.42.2(pid=7540): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7540)] 04:16:31.877665 run osmo-hlr_10.42.42.2(pid=7540): stdout: | (launched: 2022-12-14_04:16:28.401727) 04:16:31.930137 run osmo-hlr_10.42.42.2(pid=7540): stderr: | [0;m[1;31m20221214041628601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041628601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041628601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041628601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041628601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041628602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041628614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041628622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041628622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041628622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:31.981871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7533): Terminating (SIGTERM) 04:16:32.023839 run iperf3-srv_10.42.42.10(pid=7534): Terminating (SIGTERM) 04:16:32.069275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7535): Terminating (SIGTERM) 04:16:32.113039 run iperf3-srv_10.42.42.10(pid=7536): Terminating (SIGTERM) 04:16:32.156832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7539): Terminating (SIGTERM) 04:16:32.198721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7542): Terminating (SIGTERM) 04:16:32.239681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7545): Terminating (SIGTERM) 04:16:32.279845 --- ParallelTerminationStrategy: PID 7533 died... 04:16:32.298735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7533): Terminated: ok {rc=0} 04:16:32.343574 --- ParallelTerminationStrategy: PID 7534 died... 04:16:32.362337 run iperf3-srv_10.42.42.10(pid=7534): Terminated {rc=256} 04:16:32.406466 --- ParallelTerminationStrategy: PID 7535 died... 04:16:32.425363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7535): Terminated: ok {rc=0} 04:16:32.469676 --- ParallelTerminationStrategy: PID 7536 died... 04:16:32.488457 run iperf3-srv_10.42.42.10(pid=7536): Terminated {rc=256} 04:16:32.532652 --- ParallelTerminationStrategy: PID 7539 died... 04:16:32.551598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7539): Terminated: ok {rc=0} 04:16:32.595837 --- ParallelTerminationStrategy: PID 7542 died... 04:16:32.614794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7542): Terminated: ok {rc=0} 04:16:32.659053 --- ParallelTerminationStrategy: PID 7545 died... 04:16:32.677963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7545): Terminated: ok {rc=0} 04:16:32.764246 bus /gobi_0: Setting Powered False 04:16:33.865433 bus /gobi_0: Setting Powered False 04:16:34.981115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:16:36.128466 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.139977 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:36.208868 tst iperf3.py: using LAC 38484 04:16:36.328587 tst iperf3.py: using RAC 234 04:16:36.447797 tst iperf3.py: using CellId 38484 04:16:36.566958 tst iperf3.py: using BVCI 38485 04:16:36.678999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.689846 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.700513 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.711112 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.721625 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.732144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.742823 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.753389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:36.764084 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:36.880834 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:37.084216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:37.390496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Launched 04:16:37.656707 run iperf3-srv_10.42.42.10(pid=7548): Launched 04:16:37.770537 tst iperf3.py:8: start network... 04:16:37.974018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:38.446521 run create_hlr_db(pid=7549): Launched 04:16:38.569968 bus /gobi_6: Setting Powered False 04:16:39.631732 run create_hlr_db(pid=7549): Terminated: ok {rc=0} 04:16:40.055705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7551): Launched 04:16:40.360241 run osmo-hlr_10.42.42.2(pid=7552): Launched 04:16:40.475322 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:41.120188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7554): Launched 04:16:41.417872 run osmo-stp_10.42.42.5(pid=7555): Launched 04:16:41.530385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:42.048849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7557): Launched 04:16:42.163039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:42.416120 run patchelf(pid=7558): Launched 04:16:42.581188 run osmo-stp_10.42.42.5(pid=7555): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7555)] 04:16:42.707150 run osmo-stp_10.42.42.5(pid=7555): stdout: | (launched: 2022-12-14_04:16:41.362195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:42.834452 run osmo-stp_10.42.42.5(pid=7555): stderr: | [0;m[38;5;43m20221214041641534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041641534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041641535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041641535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041641535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041641535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041641536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:42.961787 run osmo-stp_10.42.42.5(pid=7555): stdout: | (launched: 2022-12-14_04:16:41.362195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:43.083842 run osmo-stp_10.42.42.5(pid=7555): stderr: | [0;m[38;5;43m20221214041641534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041641534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041641535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041641535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041641535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041641535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041641536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:43.228193 run patchelf(pid=7558): Terminating (SIGINT) 04:16:43.395850 run patchelf(pid=7558): Terminated: ok {rc=0} 04:16:43.516005 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7555): Process ended prematurely: osmo-stp_10.42.42.5(pid=7555) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7555)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 04:16:43.525679 tst iperf3.py:8: Test FAILED (7.4 sec) 04:16:43.552840 run osmo-hlr_10.42.42.2(pid=7552): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7552)] 04:16:43.600664 run osmo-hlr_10.42.42.2(pid=7552): stdout: | (launched: 2022-12-14_04:16:40.303222) 04:16:43.649859 run osmo-hlr_10.42.42.2(pid=7552): stderr: | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041640479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041640491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041640501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041640501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041640501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:43.699444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Terminating (SIGTERM) 04:16:43.738898 run iperf3-srv_10.42.42.10(pid=7548): Terminating (SIGTERM) 04:16:43.778310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7551): Terminating (SIGTERM) 04:16:43.817813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7554): Terminating (SIGTERM) 04:16:43.857254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7557): Terminating (SIGTERM) 04:16:43.897066 --- ParallelTerminationStrategy: PID 7547 died... 04:16:43.916388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7547): Terminated: ok {rc=0} 04:16:43.960224 --- ParallelTerminationStrategy: PID 7548 died... 04:16:43.978704 run iperf3-srv_10.42.42.10(pid=7548): Terminated {rc=256} 04:16:44.022051 --- ParallelTerminationStrategy: PID 7551 died... 04:16:44.040593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7551): Terminated: ok {rc=0} 04:16:44.083784 --- ParallelTerminationStrategy: PID 7554 died... 04:16:44.102150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7554): Terminated: ok {rc=0} 04:16:44.145335 --- ParallelTerminationStrategy: PID 7557 died... 04:16:44.163732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7557): Terminated: ok {rc=0} 04:16:44.248326 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:16:45.397992 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:45.409985 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:16:45.481796 tst iperf3m4.py: using LAC 38485 04:16:45.607381 tst iperf3m4.py: using RAC 235 04:16:45.735492 tst iperf3m4.py: using CellId 38485 04:16:45.871071 tst iperf3m4.py: using BVCI 38486 04:16:46.002361 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.014631 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.026743 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.040175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.058784 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.076288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.093985 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.111366 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:16:46.128432 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:46.261995 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:46.379936 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:46.515680 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:16:46.663926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:16:46.889677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:47.220322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Launched 04:16:47.512806 run iperf3-srv_10.42.42.10(pid=7560): Launched 04:16:47.633224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:16:47.847171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:48.168235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7561): Launched 04:16:48.446734 run iperf3-srv_10.42.42.10(pid=7562): Launched 04:16:48.566124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:16:48.780219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:49.101808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Launched 04:16:49.380551 run iperf3-srv_10.42.42.10(pid=7564): Launched 04:16:49.500203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:16:49.714036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:16:50.034972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7565): Launched 04:16:50.313122 run iperf3-srv_10.42.42.10(pid=7566): Launched 04:16:50.433126 tst iperf3m4.py:8: start network... 04:16:50.646614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:16:51.142699 run create_hlr_db(pid=7567): Launched 04:16:51.263818 bus /gobi_6: Setting Powered False 04:16:52.327327 run create_hlr_db(pid=7567): Terminated: ok {rc=0} 04:16:52.772122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7569): Launched 04:16:53.092302 run osmo-hlr_10.42.42.2(pid=7570): Launched 04:16:53.214457 run osmo-stp_10.42.42.5: Starting osmo-stp 04:16:53.768268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7572): Launched 04:16:54.088605 run osmo-stp_10.42.42.5(pid=7573): Launched 04:16:54.210463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:16:54.764078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7575): Launched 04:16:54.886966 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:16:55.158667 run patchelf(pid=7576): Launched 04:16:55.336815 run osmo-stp_10.42.42.5(pid=7573): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7573)] 04:16:55.472365 run osmo-stp_10.42.42.5(pid=7573): stdout: | (launched: 2022-12-14_04:16:54.029061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:55.609216 run osmo-stp_10.42.42.5(pid=7573): stderr: | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041654218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:55.745936 run osmo-stp_10.42.42.5(pid=7573): stdout: | (launched: 2022-12-14_04:16:54.029061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:16:55.877098 run osmo-stp_10.42.42.5(pid=7573): stderr: | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041654218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041654218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041654219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:16:56.032244 run patchelf(pid=7576): Terminating (SIGINT) 04:16:56.210817 run patchelf(pid=7576): Terminated: ok {rc=0} 04:16:56.339967 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7573): Process ended prematurely: osmo-stp_10.42.42.5(pid=7573) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7573)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:16:56.350276 tst iperf3m4.py:8: Test FAILED (11.0 sec) 04:16:56.378896 run osmo-hlr_10.42.42.2(pid=7570): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7570)] 04:16:56.429647 run osmo-hlr_10.42.42.2(pid=7570): stdout: | (launched: 2022-12-14_04:16:53.032559) 04:16:56.481865 run osmo-hlr_10.42.42.2(pid=7570): stderr: | [0;m[1;31m20221214041653229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041653229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041653229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041653229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041653229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041653230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041653241 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041653250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041653250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041653250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:16:56.534260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Terminating (SIGTERM) 04:16:56.576138 run iperf3-srv_10.42.42.10(pid=7560): Terminating (SIGTERM) 04:16:56.617993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7561): Terminating (SIGTERM) 04:16:56.659986 run iperf3-srv_10.42.42.10(pid=7562): Terminating (SIGTERM) 04:16:56.701871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Terminating (SIGTERM) 04:16:56.743829 run iperf3-srv_10.42.42.10(pid=7564): Terminating (SIGTERM) 04:16:56.785604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7565): Terminating (SIGTERM) 04:16:56.827494 run iperf3-srv_10.42.42.10(pid=7566): Terminating (SIGTERM) 04:16:56.869319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7569): Terminating (SIGTERM) 04:16:56.911216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7572): Terminating (SIGTERM) 04:16:56.953248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7575): Terminating (SIGTERM) 04:16:56.995801 --- ParallelTerminationStrategy: PID 7559 died... 04:16:57.016023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Terminated: ok {rc=0} 04:16:57.062504 --- ParallelTerminationStrategy: PID 7560 died... 04:16:57.082161 run iperf3-srv_10.42.42.10(pid=7560): Terminated {rc=256} 04:16:57.128278 --- ParallelTerminationStrategy: PID 7561 died... 04:16:57.147963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7561): Terminated: ok {rc=0} 04:16:57.194105 --- ParallelTerminationStrategy: PID 7562 died... 04:16:57.213921 run iperf3-srv_10.42.42.10(pid=7562): Terminated {rc=256} 04:16:57.260164 --- ParallelTerminationStrategy: PID 7563 died... 04:16:57.280406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Terminated: ok {rc=0} 04:16:57.327179 --- ParallelTerminationStrategy: PID 7564 died... 04:16:57.346959 run iperf3-srv_10.42.42.10(pid=7564): Terminated {rc=256} 04:16:57.393403 --- ParallelTerminationStrategy: PID 7565 died... 04:16:57.413266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7565): Terminated: ok {rc=0} 04:16:57.459600 --- ParallelTerminationStrategy: PID 7566 died... 04:16:57.479440 run iperf3-srv_10.42.42.10(pid=7566): Terminated {rc=256} 04:16:57.525960 --- ParallelTerminationStrategy: PID 7569 died... 04:16:57.545848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7569): Terminated: ok {rc=0} 04:16:57.592159 --- ParallelTerminationStrategy: PID 7572 died... 04:16:57.612067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7572): Terminated: ok {rc=0} 04:16:57.658486 --- ParallelTerminationStrategy: PID 7575 died... 04:16:57.678422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7575): Terminated: ok {rc=0} 04:16:57.767851 bus /gobi_4: Setting Powered False 04:16:58.867549 bus /gobi_4: Setting Powered False 04:16:59.985204 bus /gobi_1: Setting Powered False 04:17:01.088466 bus /gobi_1: Setting Powered False 04:17:02.228883 bus /gobi_0: Setting Powered False 04:17:03.328693 bus /gobi_0: Setting Powered False 04:17:04.445472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:17:05.549907 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:05.561967 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:17:05.632162 tst ping.py: using LAC 38486 04:17:05.746853 tst ping.py: using RAC 236 04:17:05.862625 tst ping.py: using CellId 38486 04:17:05.977365 tst ping.py: using BVCI 38487 04:17:06.085375 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.096654 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.107539 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.118270 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.128739 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.139835 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.150981 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:06.161693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:17:06.280230 tst ping.py:19: start network... 04:17:06.492482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:06.984340 run create_hlr_db(pid=7580): Launched 04:17:07.104919 bus /gobi_6: Setting Powered False 04:17:08.164289 run create_hlr_db(pid=7580): Terminated: ok {rc=0} 04:17:08.607129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7582): Launched 04:17:08.923222 run osmo-hlr_10.42.42.2(pid=7583): Launched 04:17:09.043527 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:09.557370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7585): Launched 04:17:09.853425 run osmo-stp_10.42.42.5(pid=7586): Launched 04:17:09.965274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:10.475854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7588): Launched 04:17:10.587778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:10.836811 run patchelf(pid=7589): Launched 04:17:11.000303 run osmo-stp_10.42.42.5(pid=7586): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7586)] 04:17:11.125378 run osmo-stp_10.42.42.5(pid=7586): stdout: | (launched: 2022-12-14_04:17:09.797685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:11.251927 run osmo-stp_10.42.42.5(pid=7586): stderr: | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041709970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:11.378850 run osmo-stp_10.42.42.5(pid=7586): stdout: | (launched: 2022-12-14_04:17:09.797685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:11.499418 run osmo-stp_10.42.42.5(pid=7586): stderr: | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041709969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041709970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041709970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:11.642235 run patchelf(pid=7589): Terminating (SIGINT) 04:17:11.807088 run patchelf(pid=7589): Terminated: ok {rc=0} 04:17:11.925953 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7586): Process ended prematurely: osmo-stp_10.42.42.5(pid=7586) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7586)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 04:17:11.934992 tst ping.py:22: Test FAILED (6.4 sec) 04:17:11.961803 run osmo-hlr_10.42.42.2(pid=7583): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7583)] 04:17:12.009985 run osmo-hlr_10.42.42.2(pid=7583): stdout: | (launched: 2022-12-14_04:17:08.864742) 04:17:12.059885 run osmo-hlr_10.42.42.2(pid=7583): stderr: | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041709060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041709072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041709080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041709080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041709081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:12.110242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7582): Terminating (SIGTERM) 04:17:12.150689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7585): Terminating (SIGTERM) 04:17:12.190799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7588): Terminating (SIGTERM) 04:17:12.231050 --- ParallelTerminationStrategy: PID 7582 died... 04:17:12.250302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7582): Terminated: ok {rc=0} 04:17:12.294301 --- ParallelTerminationStrategy: PID 7585 died... 04:17:12.312798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7585): Terminated: ok {rc=0} 04:17:12.356757 --- ParallelTerminationStrategy: PID 7588 died... 04:17:12.375370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7588): Terminated: ok {rc=0} 04:17:12.462056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:17:13.552206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:13.563966 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:17:13.637406 tst ping_idle_ping.py: using LAC 38487 04:17:13.756247 tst ping_idle_ping.py: using RAC 237 04:17:13.873820 tst ping_idle_ping.py: using CellId 38487 04:17:13.989722 tst ping_idle_ping.py: using BVCI 38488 04:17:14.100297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.111333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.122106 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.132736 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.143404 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.155587 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.167098 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:17:14.178576 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:17:14.296595 tst ping_idle_ping.py:24: start network... 04:17:14.509254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:14.998861 run create_hlr_db(pid=7590): Launched 04:17:15.120365 bus /gobi_6: Setting Powered False 04:17:16.181932 run create_hlr_db(pid=7590): Terminated: ok {rc=0} 04:17:16.634966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Launched 04:17:16.966794 run osmo-hlr_10.42.42.2(pid=7593): Launched 04:17:17.202902 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:17.750853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Launched 04:17:18.067881 run osmo-stp_10.42.42.5(pid=7596): Launched 04:17:18.187836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:18.734452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Launched 04:17:18.854849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:19.122251 run patchelf(pid=7599): Launched 04:17:19.289872 run osmo-stp_10.42.42.5(pid=7596): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] 04:17:19.415666 run osmo-stp_10.42.42.5(pid=7596): stdout: | (launched: 2022-12-14_04:17:18.009285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:19.543023 run osmo-stp_10.42.42.5(pid=7596): stderr: | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041718202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:19.670530 run osmo-stp_10.42.42.5(pid=7596): stdout: | (launched: 2022-12-14_04:17:18.009285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:19.791583 run osmo-stp_10.42.42.5(pid=7596): stderr: | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041718201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041718202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041718202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:19.935028 run patchelf(pid=7599): Terminating (SIGINT) 04:17:20.101305 run patchelf(pid=7599): Terminated: ok {rc=0} 04:17:20.221235 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7596): Process ended prematurely: osmo-stp_10.42.42.5(pid=7596) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:17:20.230475 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:17:20.257411 run osmo-hlr_10.42.42.2(pid=7593): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7593)] 04:17:20.305317 run osmo-hlr_10.42.42.2(pid=7593): stdout: | (launched: 2022-12-14_04:17:16.905775) 04:17:20.355163 run osmo-hlr_10.42.42.2(pid=7593): stderr: | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041717094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041717111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041717128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041717129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041717129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:20.405882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Terminating (SIGTERM) 04:17:20.445925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Terminating (SIGTERM) 04:17:20.485836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Terminating (SIGTERM) 04:17:20.525972 --- ParallelTerminationStrategy: PID 7592 died... 04:17:20.545278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7592): Terminated: ok {rc=0} 04:17:20.589517 --- ParallelTerminationStrategy: PID 7595 died... 04:17:20.608227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7595): Terminated: ok {rc=0} 04:17:20.652298 --- ParallelTerminationStrategy: PID 7598 died... 04:17:20.670938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7598): Terminated: ok {rc=0} 04:17:20.756420 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:17:22.060582 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:17:22.066566 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:17:22.098623 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:17:22.136923 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:17:22.225524 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:17:22.258429 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:17:22.296268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:17:22.888383 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:17:22.936231 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:22.947172 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:23.015958 tst cs_paging_gprs_active.py: using LAC 38488 04:17:23.133667 tst cs_paging_gprs_active.py: using RAC 238 04:17:23.251776 tst cs_paging_gprs_active.py: using CellId 38488 04:17:23.371742 tst cs_paging_gprs_active.py: using BVCI 38489 04:17:23.480295 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.491333 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.502079 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.512744 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.523494 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.534320 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.545704 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.556716 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:23.567595 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:23.687593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:23.809517 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:17:24.011506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:24.316696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7604): Launched 04:17:24.580774 run iperf3-srv_10.42.42.10(pid=7605): Launched 04:17:24.693113 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:17:24.893769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:25.196320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7606): Launched 04:17:25.460183 run iperf3-srv_10.42.42.10(pid=7607): Launched 04:17:25.572632 tst cs_paging_gprs_active.py:38: start network... 04:17:25.773850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:26.240809 run create_hlr_db(pid=7608): Launched 04:17:26.365164 bus /gobi_6: Setting Powered False 04:17:27.425090 run create_hlr_db(pid=7608): Terminated: ok {rc=0} 04:17:27.866041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7610): Launched 04:17:28.189085 run osmo-hlr_10.42.42.2(pid=7611): Launched 04:17:28.311225 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:28.866730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7613): Launched 04:17:29.188347 run osmo-stp_10.42.42.5(pid=7614): Launched 04:17:29.310763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:29.870892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7616): Launched 04:17:29.994395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:30.268909 run patchelf(pid=7617): Launched 04:17:30.448062 run osmo-stp_10.42.42.5(pid=7614): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7614)] 04:17:30.584457 run osmo-stp_10.42.42.5(pid=7614): stdout: | (launched: 2022-12-14_04:17:29.128670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:30.722504 run osmo-stp_10.42.42.5(pid=7614): stderr: | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041729321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:30.877659 run osmo-stp_10.42.42.5(pid=7614): stdout: | (launched: 2022-12-14_04:17:29.128670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:31.005440 run osmo-stp_10.42.42.5(pid=7614): stderr: | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041729321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041729321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041729322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:31.155905 run patchelf(pid=7617): Terminating (SIGINT) 04:17:31.329231 run patchelf(pid=7617): Terminated: ok {rc=0} 04:17:31.454437 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7614): Process ended prematurely: osmo-stp_10.42.42.5(pid=7614) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7614)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:17:31.465297 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:17:31.494135 run osmo-hlr_10.42.42.2(pid=7611): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7611)] 04:17:31.545033 run osmo-hlr_10.42.42.2(pid=7611): stdout: | (launched: 2022-12-14_04:17:28.129112) 04:17:31.596003 run osmo-hlr_10.42.42.2(pid=7611): stderr: | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041728327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041728339 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041728348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041728348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041728348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:31.646942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7604): Terminating (SIGTERM) 04:17:31.688656 run iperf3-srv_10.42.42.10(pid=7605): Terminating (SIGTERM) 04:17:31.732160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7606): Terminating (SIGTERM) 04:17:31.772823 run iperf3-srv_10.42.42.10(pid=7607): Terminating (SIGTERM) 04:17:31.813930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7610): Terminating (SIGTERM) 04:17:31.855103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7613): Terminating (SIGTERM) 04:17:31.898083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7616): Terminating (SIGTERM) 04:17:31.942684 --- ParallelTerminationStrategy: PID 7604 died... 04:17:31.962237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7604): Terminated: ok {rc=0} 04:17:32.009233 --- ParallelTerminationStrategy: PID 7605 died... 04:17:32.030170 run iperf3-srv_10.42.42.10(pid=7605): Terminated {rc=256} 04:17:32.076039 --- ParallelTerminationStrategy: PID 7606 died... 04:17:32.096030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7606): Terminated: ok {rc=0} 04:17:32.141773 --- ParallelTerminationStrategy: PID 7607 died... 04:17:32.161851 run iperf3-srv_10.42.42.10(pid=7607): Terminated {rc=256} 04:17:32.206392 --- ParallelTerminationStrategy: PID 7610 died... 04:17:32.225527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7610): Terminated: ok {rc=0} 04:17:32.269193 --- ParallelTerminationStrategy: PID 7613 died... 04:17:32.287797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7613): Terminated: ok {rc=0} 04:17:32.332686 --- ParallelTerminationStrategy: PID 7616 died... 04:17:32.351493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7616): Terminated: ok {rc=0} 04:17:32.438092 bus /gobi_0: Setting Powered False 04:17:33.538838 bus /gobi_0: Setting Powered False 04:17:34.654217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:17:35.799107 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:35.810797 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:35.881184 tst iperf3.py: using LAC 38489 04:17:36.003224 tst iperf3.py: using RAC 239 04:17:36.121361 tst iperf3.py: using CellId 38489 04:17:36.238251 tst iperf3.py: using BVCI 38490 04:17:36.346982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.358133 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.368985 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.379762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.390435 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.401700 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.412774 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.423529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:36.434404 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:36.554731 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:36.770127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:37.092094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7618): Launched 04:17:37.372521 run iperf3-srv_10.42.42.10(pid=7619): Launched 04:17:37.493620 tst iperf3.py:8: start network... 04:17:37.708911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:38.206757 run create_hlr_db(pid=7620): Launched 04:17:38.329813 bus /gobi_6: Setting Powered False 04:17:39.393630 run create_hlr_db(pid=7620): Terminated: ok {rc=0} 04:17:39.822338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Launched 04:17:40.122380 run osmo-hlr_10.42.42.2(pid=7623): Launched 04:17:40.235994 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:40.771359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Launched 04:17:41.071498 run osmo-stp_10.42.42.5(pid=7626): Launched 04:17:41.184933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:41.702247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7628): Launched 04:17:41.816158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:42.070594 run patchelf(pid=7629): Launched 04:17:42.236823 run osmo-stp_10.42.42.5(pid=7626): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] 04:17:42.363349 run osmo-stp_10.42.42.5(pid=7626): stdout: | (launched: 2022-12-14_04:17:41.015131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:42.492076 run osmo-stp_10.42.42.5(pid=7626): stderr: | [0;m[38;5;43m20221214041741187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041741188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041741188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041741188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:42.620208 run osmo-stp_10.42.42.5(pid=7626): stdout: | (launched: 2022-12-14_04:17:41.015131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:42.743167 run osmo-stp_10.42.42.5(pid=7626): stderr: | [0;m[38;5;43m20221214041741187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041741188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041741188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041741188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041741189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:42.887937 run patchelf(pid=7629): Terminating (SIGINT) 04:17:43.055222 run patchelf(pid=7629): Terminated: ok {rc=0} 04:17:43.176276 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7626): Process ended prematurely: osmo-stp_10.42.42.5(pid=7626) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 04:17:43.185872 tst iperf3.py:8: Test FAILED (7.4 sec) 04:17:43.212518 run osmo-hlr_10.42.42.2(pid=7623): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7623)] 04:17:43.260360 run osmo-hlr_10.42.42.2(pid=7623): stdout: | (launched: 2022-12-14_04:17:40.065954) 04:17:43.309506 run osmo-hlr_10.42.42.2(pid=7623): stderr: | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041740243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041740259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041740269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041740269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041740269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:43.359337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7618): Terminating (SIGTERM) 04:17:43.398535 run iperf3-srv_10.42.42.10(pid=7619): Terminating (SIGTERM) 04:17:43.437886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Terminating (SIGTERM) 04:17:43.477271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Terminating (SIGTERM) 04:17:43.516750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7628): Terminating (SIGTERM) 04:17:43.556312 --- ParallelTerminationStrategy: PID 7618 died... 04:17:43.575231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7618): Terminated: ok {rc=0} 04:17:43.618719 --- ParallelTerminationStrategy: PID 7619 died... 04:17:43.637196 run iperf3-srv_10.42.42.10(pid=7619): Terminated {rc=256} 04:17:43.680436 --- ParallelTerminationStrategy: PID 7622 died... 04:17:43.698805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Terminated: ok {rc=0} 04:17:43.742922 --- ParallelTerminationStrategy: PID 7625 died... 04:17:43.761520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Terminated: ok {rc=0} 04:17:43.805108 --- ParallelTerminationStrategy: PID 7628 died... 04:17:43.823742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7628): Terminated: ok {rc=0} 04:17:43.909777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:17:45.055217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.067170 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:17:45.138344 tst iperf3m4.py: using LAC 38490 04:17:45.256524 tst iperf3m4.py: using RAC 240 04:17:45.373921 tst iperf3m4.py: using CellId 38490 04:17:45.492496 tst iperf3m4.py: using BVCI 38491 04:17:45.600503 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.611529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.622340 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.633029 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.643592 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.654386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.665242 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.676306 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:17:45.687604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:45.807261 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:45.950081 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:46.078673 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:17:46.229717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:17:46.441696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:46.817714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7630): Launched 04:17:47.116362 run iperf3-srv_10.42.42.10(pid=7631): Launched 04:17:47.246335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:17:47.445945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:47.746797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7632): Launched 04:17:48.007774 run iperf3-srv_10.42.42.10(pid=7633): Launched 04:17:48.119823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:17:48.317537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:48.618804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7634): Launched 04:17:48.879900 run iperf3-srv_10.42.42.10(pid=7635): Launched 04:17:48.991661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:17:49.189543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:17:49.490634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7636): Launched 04:17:49.751628 run iperf3-srv_10.42.42.10(pid=7637): Launched 04:17:49.863533 tst iperf3m4.py:8: start network... 04:17:50.062451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:17:50.529547 run create_hlr_db(pid=7638): Launched 04:17:50.652728 bus /gobi_6: Setting Powered False 04:17:51.713284 run create_hlr_db(pid=7638): Terminated: ok {rc=0} 04:17:52.133103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Launched 04:17:52.434186 run osmo-hlr_10.42.42.2(pid=7641): Launched 04:17:52.548763 run osmo-stp_10.42.42.5: Starting osmo-stp 04:17:53.066331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Launched 04:17:53.366914 run osmo-stp_10.42.42.5(pid=7644): Launched 04:17:53.479867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:17:53.999436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7646): Launched 04:17:54.113588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:17:54.367693 run patchelf(pid=7647): Launched 04:17:54.534746 run osmo-stp_10.42.42.5(pid=7644): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] 04:17:54.661673 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-14_04:17:53.310209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:54.790022 run osmo-stp_10.42.42.5(pid=7644): stderr: | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041753480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:54.918759 run osmo-stp_10.42.42.5(pid=7644): stdout: | (launched: 2022-12-14_04:17:53.310209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:17:55.042272 run osmo-stp_10.42.42.5(pid=7644): stderr: | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041753479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041753480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041753480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:17:55.188231 run patchelf(pid=7647): Terminating (SIGINT) 04:17:55.355776 run patchelf(pid=7647): Terminated: ok {rc=0} 04:17:55.476675 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:17:55.486367 tst iperf3m4.py:8: Test FAILED (10.5 sec) 04:17:55.513559 run osmo-hlr_10.42.42.2(pid=7641): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7641)] 04:17:55.561418 run osmo-hlr_10.42.42.2(pid=7641): stdout: | (launched: 2022-12-14_04:17:52.377566) 04:17:55.610654 run osmo-hlr_10.42.42.2(pid=7641): stderr: | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041752553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041752565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041752574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041752574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041752574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:17:55.660243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7630): Terminating (SIGTERM) 04:17:55.699611 run iperf3-srv_10.42.42.10(pid=7631): Terminating (SIGTERM) 04:17:55.739046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7632): Terminating (SIGTERM) 04:17:55.778484 run iperf3-srv_10.42.42.10(pid=7633): Terminating (SIGTERM) 04:17:55.818062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7634): Terminating (SIGTERM) 04:17:55.857795 run iperf3-srv_10.42.42.10(pid=7635): Terminating (SIGTERM) 04:17:55.897381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7636): Terminating (SIGTERM) 04:17:55.937115 run iperf3-srv_10.42.42.10(pid=7637): Terminating (SIGTERM) 04:17:55.976709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Terminating (SIGTERM) 04:17:56.016102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Terminating (SIGTERM) 04:17:56.055536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7646): Terminating (SIGTERM) 04:17:56.095353 --- ParallelTerminationStrategy: PID 7630 died... 04:17:56.114403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7630): Terminated: ok {rc=0} 04:17:56.158187 --- ParallelTerminationStrategy: PID 7631 died... 04:17:56.176664 run iperf3-srv_10.42.42.10(pid=7631): Terminated {rc=256} 04:17:56.220619 --- ParallelTerminationStrategy: PID 7632 died... 04:17:56.239285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7632): Terminated: ok {rc=0} 04:17:56.283072 --- ParallelTerminationStrategy: PID 7633 died... 04:17:56.301578 run iperf3-srv_10.42.42.10(pid=7633): Terminated {rc=256} 04:17:56.345257 --- ParallelTerminationStrategy: PID 7634 died... 04:17:56.363878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7634): Terminated: ok {rc=0} 04:17:56.407690 --- ParallelTerminationStrategy: PID 7635 died... 04:17:56.426293 run iperf3-srv_10.42.42.10(pid=7635): Terminated {rc=256} 04:17:56.470198 --- ParallelTerminationStrategy: PID 7636 died... 04:17:56.488841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7636): Terminated: ok {rc=0} 04:17:56.533557 --- ParallelTerminationStrategy: PID 7637 died... 04:17:56.552230 run iperf3-srv_10.42.42.10(pid=7637): Terminated {rc=256} 04:17:56.596266 --- ParallelTerminationStrategy: PID 7640 died... 04:17:56.614956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7640): Terminated: ok {rc=0} 04:17:56.658679 --- ParallelTerminationStrategy: PID 7643 died... 04:17:56.677362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7643): Terminated: ok {rc=0} 04:17:56.721154 --- ParallelTerminationStrategy: PID 7646 died... 04:17:56.739883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7646): Terminated: ok {rc=0} 04:17:56.825634 bus /gobi_4: Setting Powered False 04:17:57.926135 bus /gobi_4: Setting Powered False 04:17:59.044047 bus /gobi_1: Setting Powered False 04:18:00.144163 bus /gobi_1: Setting Powered False 04:18:01.261716 bus /gobi_0: Setting Powered False 04:18:02.372345 bus /gobi_0: Setting Powered False 04:18:03.491564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:18:04.595491 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:04.607535 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:18:04.680072 tst ping.py: using LAC 38491 04:18:04.806046 tst ping.py: using RAC 241 04:18:04.930991 tst ping.py: using CellId 38491 04:18:05.055880 tst ping.py: using BVCI 38492 04:18:05.171317 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.182725 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.194486 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.205662 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.217039 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.231723 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.244713 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:05.256329 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:18:05.375684 tst ping.py:19: start network... 04:18:05.587522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:06.079050 run create_hlr_db(pid=7648): Launched 04:18:06.198765 bus /gobi_6: Setting Powered False 04:18:07.261747 run create_hlr_db(pid=7648): Terminated: ok {rc=0} 04:18:07.687718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7650): Launched 04:18:07.983234 run osmo-hlr_10.42.42.2(pid=7651): Launched 04:18:08.094923 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:08.603037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7653): Launched 04:18:08.898367 run osmo-stp_10.42.42.5(pid=7654): Launched 04:18:09.009364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:09.517966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7656): Launched 04:18:09.629987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:09.879244 run patchelf(pid=7657): Launched 04:18:10.042811 run osmo-stp_10.42.42.5(pid=7654): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7654)] 04:18:10.168155 run osmo-stp_10.42.42.5(pid=7654): stdout: | (launched: 2022-12-14_04:18:08.842571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:10.295242 run osmo-stp_10.42.42.5(pid=7654): stderr: | [0;m[38;5;43m20221214041809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041809012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041809012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:10.423259 run osmo-stp_10.42.42.5(pid=7654): stdout: | (launched: 2022-12-14_04:18:08.842571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:10.544053 run osmo-stp_10.42.42.5(pid=7654): stderr: | [0;m[38;5;43m20221214041809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041809011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041809012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041809012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041809013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:10.688437 run patchelf(pid=7657): Terminating (SIGINT) 04:18:10.853793 run patchelf(pid=7657): Terminated: ok {rc=0} 04:18:10.972481 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7654): Process ended prematurely: osmo-stp_10.42.42.5(pid=7654) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7654)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 04:18:10.981459 tst ping.py:22: Test FAILED (6.4 sec) 04:18:11.008145 run osmo-hlr_10.42.42.2(pid=7651): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7651)] 04:18:11.056024 run osmo-hlr_10.42.42.2(pid=7651): stdout: | (launched: 2022-12-14_04:18:07.927916) 04:18:11.105766 run osmo-hlr_10.42.42.2(pid=7651): stderr: | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041808102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041808116 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041808126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041808126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041808127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:11.156061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7650): Terminating (SIGTERM) 04:18:11.196337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7653): Terminating (SIGTERM) 04:18:11.236656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7656): Terminating (SIGTERM) 04:18:11.277118 --- ParallelTerminationStrategy: PID 7650 died... 04:18:11.296542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7650): Terminated: ok {rc=0} 04:18:11.341194 --- ParallelTerminationStrategy: PID 7653 died... 04:18:11.360131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7653): Terminated: ok {rc=0} 04:18:11.404371 --- ParallelTerminationStrategy: PID 7656 died... 04:18:11.423320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7656): Terminated: ok {rc=0} 04:18:11.507191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:18:12.595078 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:12.607304 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:18:12.687327 tst ping_idle_ping.py: using LAC 38492 04:18:12.812491 tst ping_idle_ping.py: using RAC 242 04:18:12.935501 tst ping_idle_ping.py: using CellId 38492 04:18:13.062006 tst ping_idle_ping.py: using BVCI 38493 04:18:13.179195 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.190942 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.202315 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.213934 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.225485 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.237076 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.248777 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:18:13.260448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:18:13.382529 tst ping_idle_ping.py:24: start network... 04:18:13.596021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:14.087535 run create_hlr_db(pid=7658): Launched 04:18:14.207274 bus /gobi_6: Setting Powered False 04:18:15.270169 run create_hlr_db(pid=7658): Terminated: ok {rc=0} 04:18:15.696771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7660): Launched 04:18:16.012096 run osmo-hlr_10.42.42.2(pid=7661): Launched 04:18:16.240889 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:16.862501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7663): Launched 04:18:17.241699 run osmo-stp_10.42.42.5(pid=7664): Launched 04:18:17.390377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:17.949482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7666): Launched 04:18:18.071201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:18.341519 run patchelf(pid=7667): Launched 04:18:18.518852 run osmo-stp_10.42.42.5(pid=7664): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7664)] 04:18:18.654698 run osmo-stp_10.42.42.5(pid=7664): stdout: | (launched: 2022-12-14_04:18:17.173808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:18.792365 run osmo-stp_10.42.42.5(pid=7664): stderr: | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041817428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:18.930162 run osmo-stp_10.42.42.5(pid=7664): stdout: | (launched: 2022-12-14_04:18:17.173808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:19.061144 run osmo-stp_10.42.42.5(pid=7664): stderr: | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041817427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041817428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041817428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:19.216021 run patchelf(pid=7667): Terminating (SIGINT) 04:18:19.395622 run patchelf(pid=7667): Terminated: ok {rc=0} 04:18:19.524741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7664): Process ended prematurely: osmo-stp_10.42.42.5(pid=7664) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7664)] [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:18:19.534453 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 04:18:19.562690 run osmo-hlr_10.42.42.2(pid=7661): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7661)] 04:18:19.613701 run osmo-hlr_10.42.42.2(pid=7661): stdout: | (launched: 2022-12-14_04:18:15.952936) 04:18:19.666168 run osmo-hlr_10.42.42.2(pid=7661): stderr: | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041816236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041816276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041816292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041816293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041816293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:19.719230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7660): Terminating (SIGTERM) 04:18:19.761315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7663): Terminating (SIGTERM) 04:18:19.803113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7666): Terminating (SIGTERM) 04:18:19.845489 --- ParallelTerminationStrategy: PID 7660 died... 04:18:19.866056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7660): Terminated: ok {rc=0} 04:18:19.912558 --- ParallelTerminationStrategy: PID 7663 died... 04:18:19.932612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7663): Terminated: ok {rc=0} 04:18:19.978950 --- ParallelTerminationStrategy: PID 7666 died... 04:18:19.999004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7666): Terminated: ok {rc=0} 04:18:20.088159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:18:21.395505 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:18:21.402541 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:18:21.435537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:18:21.475843 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:18:21.571793 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:18:21.604265 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:18:21.642432 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:18:22.246709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:18:22.298921 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.310703 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:22.362434 tst cs_paging_gprs_active.py: using LAC 38493 04:18:22.489462 tst cs_paging_gprs_active.py: using RAC 243 04:18:22.607579 tst cs_paging_gprs_active.py: using CellId 38493 04:18:22.734194 tst cs_paging_gprs_active.py: using BVCI 38494 04:18:22.851711 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.863429 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.875062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.886692 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.898450 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.910200 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.922112 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.933932 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:22.945960 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:23.062870 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:23.184602 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:18:23.386619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:23.689127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7671): Launched 04:18:23.951993 run iperf3-srv_10.42.42.10(pid=7672): Launched 04:18:24.064013 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:18:24.264604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:24.566922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7673): Launched 04:18:24.830906 run iperf3-srv_10.42.42.10(pid=7674): Launched 04:18:24.943699 tst cs_paging_gprs_active.py:38: start network... 04:18:25.144293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:25.613668 run create_hlr_db(pid=7675): Launched 04:18:25.740218 bus /gobi_6: Setting Powered False 04:18:26.801170 run create_hlr_db(pid=7675): Terminated: ok {rc=0} 04:18:27.243606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7677): Launched 04:18:27.567800 run osmo-hlr_10.42.42.2(pid=7678): Launched 04:18:27.691763 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:28.250363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7680): Launched 04:18:28.572513 run osmo-stp_10.42.42.5(pid=7681): Launched 04:18:28.695475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:29.251753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7683): Launched 04:18:29.375638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:29.648094 run patchelf(pid=7684): Launched 04:18:29.827238 run osmo-stp_10.42.42.5(pid=7681): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7681)] 04:18:29.963485 run osmo-stp_10.42.42.5(pid=7681): stdout: | (launched: 2022-12-14_04:18:28.512865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:30.101653 run osmo-stp_10.42.42.5(pid=7681): stderr: | [0;m[38;5;43m20221214041828704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041828704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041828705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041828707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:30.239566 run osmo-stp_10.42.42.5(pid=7681): stdout: | (launched: 2022-12-14_04:18:28.512865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:30.372337 run osmo-stp_10.42.42.5(pid=7681): stderr: | [0;m[38;5;43m20221214041828704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041828704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041828705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041828707 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041828707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:30.528878 run patchelf(pid=7684): Terminating (SIGINT) 04:18:30.708497 run patchelf(pid=7684): Terminated: ok {rc=0} 04:18:30.839626 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7681): Process ended prematurely: osmo-stp_10.42.42.5(pid=7681) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7681)] [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:18:30.854562 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 04:18:30.897810 run osmo-hlr_10.42.42.2(pid=7678): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7678)] 04:18:30.952196 run osmo-hlr_10.42.42.2(pid=7678): stdout: | (launched: 2022-12-14_04:18:27.507858) 04:18:31.004585 run osmo-hlr_10.42.42.2(pid=7678): stderr: | [0;m[1;31m20221214041827705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041827706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041827706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041827706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041827706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041827706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041827718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041827726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041827727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041827727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:31.056528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7671): Terminating (SIGTERM) 04:18:31.098629 run iperf3-srv_10.42.42.10(pid=7672): Terminating (SIGTERM) 04:18:31.142314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7673): Terminating (SIGTERM) 04:18:31.183031 run iperf3-srv_10.42.42.10(pid=7674): Terminating (SIGTERM) 04:18:31.225787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7677): Terminating (SIGTERM) 04:18:31.267527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7680): Terminating (SIGTERM) 04:18:31.311933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7683): Terminating (SIGTERM) 04:18:31.355784 --- ParallelTerminationStrategy: PID 7671 died... 04:18:31.375691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7671): Terminated: ok {rc=0} 04:18:31.422519 --- ParallelTerminationStrategy: PID 7672 died... 04:18:31.442045 run iperf3-srv_10.42.42.10(pid=7672): Terminated {rc=256} 04:18:31.486713 --- ParallelTerminationStrategy: PID 7673 died... 04:18:31.507914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7673): Terminated: ok {rc=0} 04:18:31.553547 --- ParallelTerminationStrategy: PID 7674 died... 04:18:31.573510 run iperf3-srv_10.42.42.10(pid=7674): Terminated {rc=256} 04:18:31.619477 --- ParallelTerminationStrategy: PID 7677 died... 04:18:31.638918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7677): Terminated: ok {rc=0} 04:18:31.684164 --- ParallelTerminationStrategy: PID 7680 died... 04:18:31.703667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7680): Terminated: ok {rc=0} 04:18:31.750759 --- ParallelTerminationStrategy: PID 7683 died... 04:18:31.770561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7683): Terminated: ok {rc=0} 04:18:31.860719 bus /gobi_0: Setting Powered False 04:18:32.968864 bus /gobi_0: Setting Powered False 04:18:34.083506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:18:35.228517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.240489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:35.294527 tst iperf3.py: using LAC 38494 04:18:35.415294 tst iperf3.py: using RAC 244 04:18:35.534586 tst iperf3.py: using CellId 38494 04:18:35.654155 tst iperf3.py: using BVCI 38495 04:18:35.764465 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.775814 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.786974 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.798165 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.809297 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.820374 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.831601 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.842774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:35.854170 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:35.970868 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:18:36.171514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:36.474633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7685): Launched 04:18:36.737107 run iperf3-srv_10.42.42.10(pid=7686): Launched 04:18:36.850178 tst iperf3.py:8: start network... 04:18:37.050846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:37.516281 run create_hlr_db(pid=7687): Launched 04:18:37.639193 bus /gobi_6: Setting Powered False 04:18:38.703786 run create_hlr_db(pid=7687): Terminated: ok {rc=0} 04:18:39.134531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7689): Launched 04:18:39.435361 run osmo-hlr_10.42.42.2(pid=7690): Launched 04:18:39.548446 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:40.082154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7692): Launched 04:18:40.382399 run osmo-stp_10.42.42.5(pid=7693): Launched 04:18:40.495403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:41.012110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7695): Launched 04:18:41.128705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:41.383200 run patchelf(pid=7696): Launched 04:18:41.549857 run osmo-stp_10.42.42.5(pid=7693): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7693)] 04:18:41.676572 run osmo-stp_10.42.42.5(pid=7693): stdout: | (launched: 2022-12-14_04:18:40.326136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:41.804839 run osmo-stp_10.42.42.5(pid=7693): stderr: | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041840497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:41.933413 run osmo-stp_10.42.42.5(pid=7693): stdout: | (launched: 2022-12-14_04:18:40.326136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:42.056115 run osmo-stp_10.42.42.5(pid=7693): stderr: | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041840496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041840497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041840497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:42.202081 run patchelf(pid=7696): Terminating (SIGINT) 04:18:42.369927 run patchelf(pid=7696): Terminated: ok {rc=0} 04:18:42.490952 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7693): Process ended prematurely: osmo-stp_10.42.42.5(pid=7693) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7693)] [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:18:42.500479 tst iperf3.py:8: Test FAILED (7.3 sec) 04:18:42.527492 run osmo-hlr_10.42.42.2(pid=7690): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7690)] 04:18:42.575729 run osmo-hlr_10.42.42.2(pid=7690): stdout: | (launched: 2022-12-14_04:18:39.378712) 04:18:42.625194 run osmo-hlr_10.42.42.2(pid=7690): stderr: | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041839554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041839566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041839575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041839575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041839575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:42.674980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7685): Terminating (SIGTERM) 04:18:42.714868 run iperf3-srv_10.42.42.10(pid=7686): Terminating (SIGTERM) 04:18:42.754275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7689): Terminating (SIGTERM) 04:18:42.793820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7692): Terminating (SIGTERM) 04:18:42.833599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7695): Terminating (SIGTERM) 04:18:42.873999 --- ParallelTerminationStrategy: PID 7685 died... 04:18:42.893527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7685): Terminated: ok {rc=0} 04:18:42.937588 --- ParallelTerminationStrategy: PID 7686 died... 04:18:42.956124 run iperf3-srv_10.42.42.10(pid=7686): Terminated {rc=256} 04:18:42.999927 --- ParallelTerminationStrategy: PID 7689 died... 04:18:43.018705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7689): Terminated: ok {rc=0} 04:18:43.062568 --- ParallelTerminationStrategy: PID 7692 died... 04:18:43.081414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7692): Terminated: ok {rc=0} 04:18:43.125653 --- ParallelTerminationStrategy: PID 7695 died... 04:18:43.144492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7695): Terminated: ok {rc=0} 04:18:43.230947 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:18:44.382772 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.395353 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:18:44.450552 tst iperf3m4.py: using LAC 38495 04:18:44.578453 tst iperf3m4.py: using RAC 245 04:18:44.705172 tst iperf3m4.py: using CellId 38495 04:18:44.823771 tst iperf3m4.py: using BVCI 38496 04:18:44.933471 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.945050 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.956399 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.967674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.979192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:44.990664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:45.002227 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:45.013435 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:18:45.024815 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:45.145546 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:45.265904 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:45.385160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:18:45.506432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:18:45.723298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:46.073599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7697): Launched 04:18:46.350928 run iperf3-srv_10.42.42.10(pid=7698): Launched 04:18:46.517765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:18:46.811331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:47.161671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Launched 04:18:47.435578 run iperf3-srv_10.42.42.10(pid=7700): Launched 04:18:47.548719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:18:47.748685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:48.050983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Launched 04:18:48.313133 run iperf3-srv_10.42.42.10(pid=7702): Launched 04:18:48.425639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:18:48.624740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:18:48.926738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Launched 04:18:49.189815 run iperf3-srv_10.42.42.10(pid=7704): Launched 04:18:49.302891 tst iperf3m4.py:8: start network... 04:18:49.502688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:18:49.971910 run create_hlr_db(pid=7705): Launched 04:18:50.094642 bus /gobi_6: Setting Powered False 04:18:51.154920 run create_hlr_db(pid=7705): Terminated: ok {rc=0} 04:18:51.597136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Launched 04:18:51.919783 run osmo-hlr_10.42.42.2(pid=7708): Launched 04:18:52.042558 run osmo-stp_10.42.42.5: Starting osmo-stp 04:18:52.605153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Launched 04:18:52.928937 run osmo-stp_10.42.42.5(pid=7711): Launched 04:18:53.051398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:18:53.611200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7713): Launched 04:18:53.736158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:18:54.010316 run patchelf(pid=7714): Launched 04:18:54.189477 run osmo-stp_10.42.42.5(pid=7711): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] 04:18:54.326432 run osmo-stp_10.42.42.5(pid=7711): stdout: | (launched: 2022-12-14_04:18:52.869280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:54.465451 run osmo-stp_10.42.42.5(pid=7711): stderr: | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041853057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:54.603618 run osmo-stp_10.42.42.5(pid=7711): stdout: | (launched: 2022-12-14_04:18:52.869280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:18:54.736284 run osmo-stp_10.42.42.5(pid=7711): stderr: | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041853057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041853057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041853058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:18:54.893364 run patchelf(pid=7714): Terminating (SIGINT) 04:18:55.073571 run patchelf(pid=7714): Terminated: ok {rc=0} 04:18:55.203456 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7711): Process ended prematurely: osmo-stp_10.42.42.5(pid=7711) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:18:55.213878 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:18:55.242885 run osmo-hlr_10.42.42.2(pid=7708): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7708)] 04:18:55.293872 run osmo-hlr_10.42.42.2(pid=7708): stdout: | (launched: 2022-12-14_04:18:51.860015) 04:18:55.346187 run osmo-hlr_10.42.42.2(pid=7708): stderr: | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041852055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041852068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041852078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041852078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041852078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:18:55.399102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7697): Terminating (SIGTERM) 04:18:55.441136 run iperf3-srv_10.42.42.10(pid=7698): Terminating (SIGTERM) 04:18:55.482748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Terminating (SIGTERM) 04:18:55.524676 run iperf3-srv_10.42.42.10(pid=7700): Terminating (SIGTERM) 04:18:55.567169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Terminating (SIGTERM) 04:18:55.609815 run iperf3-srv_10.42.42.10(pid=7702): Terminating (SIGTERM) 04:18:55.652055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Terminating (SIGTERM) 04:18:55.694457 run iperf3-srv_10.42.42.10(pid=7704): Terminating (SIGTERM) 04:18:55.736744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Terminating (SIGTERM) 04:18:55.779180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminating (SIGTERM) 04:18:55.821843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7713): Terminating (SIGTERM) 04:18:55.864500 --- ParallelTerminationStrategy: PID 7697 died... 04:18:55.884793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7697): Terminated: ok {rc=0} 04:18:55.932193 --- ParallelTerminationStrategy: PID 7698 died... 04:18:55.951848 run iperf3-srv_10.42.42.10(pid=7698): Terminated {rc=256} 04:18:55.997767 --- ParallelTerminationStrategy: PID 7699 died... 04:18:56.017434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Terminated: ok {rc=0} 04:18:56.063423 --- ParallelTerminationStrategy: PID 7700 died... 04:18:56.083161 run iperf3-srv_10.42.42.10(pid=7700): Terminated {rc=256} 04:18:56.129115 --- ParallelTerminationStrategy: PID 7701 died... 04:18:56.148850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Terminated: ok {rc=0} 04:18:56.195158 --- ParallelTerminationStrategy: PID 7702 died... 04:18:56.214890 run iperf3-srv_10.42.42.10(pid=7702): Terminated {rc=256} 04:18:56.260774 --- ParallelTerminationStrategy: PID 7703 died... 04:18:56.280540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Terminated: ok {rc=0} 04:18:56.326548 --- ParallelTerminationStrategy: PID 7704 died... 04:18:56.346367 run iperf3-srv_10.42.42.10(pid=7704): Terminated {rc=256} 04:18:56.392539 --- ParallelTerminationStrategy: PID 7707 died... 04:18:56.412518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7707): Terminated: ok {rc=0} 04:18:56.458945 --- ParallelTerminationStrategy: PID 7710 died... 04:18:56.478819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminated: ok {rc=0} 04:18:56.524935 --- ParallelTerminationStrategy: PID 7713 died... 04:18:56.544876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7713): Terminated: ok {rc=0} 04:18:56.632838 bus /gobi_4: Setting Powered False 04:18:57.731949 bus /gobi_4: Setting Powered False 04:18:58.846454 bus /gobi_1: Setting Powered False 04:18:59.945134 bus /gobi_1: Setting Powered False 04:19:01.059276 bus /gobi_0: Setting Powered False 04:19:02.154837 bus /gobi_0: Setting Powered False 04:19:03.268551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:19:04.371725 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.384386 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:19:04.446475 tst ping.py: using LAC 38496 04:19:04.570456 tst ping.py: using RAC 246 04:19:04.692249 tst ping.py: using CellId 38496 04:19:04.814325 tst ping.py: using BVCI 38497 04:19:04.930314 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.942162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.953718 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.965310 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.977016 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:04.988843 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:05.000753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:05.012664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:19:05.131291 tst ping.py:19: start network... 04:19:05.343793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:05.834636 run create_hlr_db(pid=7716): Launched 04:19:05.955210 bus /gobi_6: Setting Powered False 04:19:07.018384 run create_hlr_db(pid=7716): Terminated: ok {rc=0} 04:19:07.443545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7718): Launched 04:19:07.738541 run osmo-hlr_10.42.42.2(pid=7719): Launched 04:19:07.850229 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:08.379097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7721): Launched 04:19:08.674488 run osmo-stp_10.42.42.5(pid=7722): Launched 04:19:08.786190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:09.296420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7724): Launched 04:19:09.409495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:09.659947 run patchelf(pid=7725): Launched 04:19:09.824587 run osmo-stp_10.42.42.5(pid=7722): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7722)] 04:19:09.949418 run osmo-stp_10.42.42.5(pid=7722): stdout: | (launched: 2022-12-14_04:19:08.618640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:10.076349 run osmo-stp_10.42.42.5(pid=7722): stderr: | [0;m[38;5;43m20221214041908787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041908788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041908788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041908788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:10.203848 run osmo-stp_10.42.42.5(pid=7722): stdout: | (launched: 2022-12-14_04:19:08.618640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:10.324671 run osmo-stp_10.42.42.5(pid=7722): stderr: | [0;m[38;5;43m20221214041908787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041908788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041908788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041908788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041908789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:10.467927 run patchelf(pid=7725): Terminating (SIGINT) 04:19:10.633357 run patchelf(pid=7725): Terminated: ok {rc=0} 04:19:10.752040 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7722): Process ended prematurely: osmo-stp_10.42.42.5(pid=7722) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7722)] [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:19:10.761082 tst ping.py:22: Test FAILED (6.4 sec) 04:19:10.787677 run osmo-hlr_10.42.42.2(pid=7719): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7719)] 04:19:10.835458 run osmo-hlr_10.42.42.2(pid=7719): stdout: | (launched: 2022-12-14_04:19:07.683278) 04:19:10.884752 run osmo-hlr_10.42.42.2(pid=7719): stderr: | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041907858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041907870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041907879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041907879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041907879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:10.934374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7718): Terminating (SIGTERM) 04:19:10.973729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7721): Terminating (SIGTERM) 04:19:11.013103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7724): Terminating (SIGTERM) 04:19:11.052491 --- ParallelTerminationStrategy: PID 7718 died... 04:19:11.071685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7718): Terminated: ok {rc=0} 04:19:11.115712 --- ParallelTerminationStrategy: PID 7721 died... 04:19:11.134458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7721): Terminated: ok {rc=0} 04:19:11.177969 --- ParallelTerminationStrategy: PID 7724 died... 04:19:11.196541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7724): Terminated: ok {rc=0} 04:19:11.281288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:19:12.369313 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.381559 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:19:12.433422 tst ping_idle_ping.py: using LAC 38497 04:19:12.554762 tst ping_idle_ping.py: using RAC 247 04:19:12.669558 tst ping_idle_ping.py: using CellId 38497 04:19:12.785028 tst ping_idle_ping.py: using BVCI 38498 04:19:12.901997 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.913826 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.925384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.936926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.948923 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.960740 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.972694 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:19:12.984611 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:19:13.101547 tst ping_idle_ping.py:24: start network... 04:19:13.300736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:13.762839 run create_hlr_db(pid=7726): Launched 04:19:13.884942 bus /gobi_6: Setting Powered False 04:19:14.945088 run create_hlr_db(pid=7726): Terminated: ok {rc=0} 04:19:15.359691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7728): Launched 04:19:15.655545 run osmo-hlr_10.42.42.2(pid=7729): Launched 04:19:15.767259 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:16.434389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7731): Launched 04:19:16.747331 run osmo-stp_10.42.42.5(pid=7732): Launched 04:19:16.893037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:17.613224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7734): Launched 04:19:17.725796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:17.975890 run patchelf(pid=7735): Launched 04:19:18.140274 run osmo-stp_10.42.42.5(pid=7732): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7732)] 04:19:18.265498 run osmo-stp_10.42.42.5(pid=7732): stdout: | (launched: 2022-12-14_04:19:16.685110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:18.392581 run osmo-stp_10.42.42.5(pid=7732): stderr: | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041916999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:18.519884 run osmo-stp_10.42.42.5(pid=7732): stdout: | (launched: 2022-12-14_04:19:16.685110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:18.640668 run osmo-stp_10.42.42.5(pid=7732): stderr: | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041916998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041916999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041916999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:18.783738 run patchelf(pid=7735): Terminating (SIGINT) 04:19:18.949143 run patchelf(pid=7735): Terminated: ok {rc=0} 04:19:19.067915 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7732): Process ended prematurely: osmo-stp_10.42.42.5(pid=7732) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7732)] [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:19:19.076998 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:19:19.103542 run osmo-hlr_10.42.42.2(pid=7729): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7729)] 04:19:19.151891 run osmo-hlr_10.42.42.2(pid=7729): stdout: | (launched: 2022-12-14_04:19:15.599670) 04:19:19.201222 run osmo-hlr_10.42.42.2(pid=7729): stderr: | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041915777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041915790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041915799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041915799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041915799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:19.250835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7728): Terminating (SIGTERM) 04:19:19.290130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7731): Terminating (SIGTERM) 04:19:19.329404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7734): Terminating (SIGTERM) 04:19:19.369721 --- ParallelTerminationStrategy: PID 7728 died... 04:19:19.388936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7728): Terminated: ok {rc=0} 04:19:19.432789 --- ParallelTerminationStrategy: PID 7731 died... 04:19:19.451484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7731): Terminated: ok {rc=0} 04:19:19.495092 --- ParallelTerminationStrategy: PID 7734 died... 04:19:19.513817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7734): Terminated: ok {rc=0} 04:19:19.599393 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:19:20.906204 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:20.914006 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:19:20.946085 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:19:20.980561 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:19:21.032670 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:19:21.064665 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:19:21.099496 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:19:21.663806 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:19:21.668683 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:21.679849 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:19:21.749350 tst switch_tch_pdch.py: using LAC 38498 04:19:21.869671 tst switch_tch_pdch.py: using RAC 248 04:19:21.997333 tst switch_tch_pdch.py: using CellId 38498 04:19:22.121448 tst switch_tch_pdch.py: using BVCI 38499 04:19:22.237969 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.249649 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.261992 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.273432 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.285191 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.296760 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.309243 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:19:22.321530 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:19:22.438156 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:19:22.557947 tst switch_tch_pdch.py:51: start network... 04:19:22.770812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:23.261446 run create_hlr_db(pid=7739): Launched 04:19:23.381491 bus /gobi_6: Setting Powered False 04:19:24.444311 run create_hlr_db(pid=7739): Terminated: ok {rc=0} 04:19:24.868250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7741): Launched 04:19:25.162750 run osmo-hlr_10.42.42.2(pid=7742): Launched 04:19:25.274844 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:25.799906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7744): Launched 04:19:26.094056 run osmo-stp_10.42.42.5(pid=7745): Launched 04:19:26.205640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:26.715736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7747): Launched 04:19:26.827667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:27.076538 run patchelf(pid=7748): Launched 04:19:27.242761 run osmo-stp_10.42.42.5(pid=7745): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7745)] 04:19:27.367268 run osmo-stp_10.42.42.5(pid=7745): stdout: | (launched: 2022-12-14_04:19:26.038524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:27.493767 run osmo-stp_10.42.42.5(pid=7745): stderr: | [0;m[38;5;43m20221214041926207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041926207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041926208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041926208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:27.620221 run osmo-stp_10.42.42.5(pid=7745): stdout: | (launched: 2022-12-14_04:19:26.038524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:27.740514 run osmo-stp_10.42.42.5(pid=7745): stderr: | [0;m[38;5;43m20221214041926207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041926207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041926208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041926208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041926209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:27.883083 run patchelf(pid=7748): Terminating (SIGINT) 04:19:28.047331 run patchelf(pid=7748): Terminated: ok {rc=0} 04:19:28.165853 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7745): Process ended prematurely: osmo-stp_10.42.42.5(pid=7745) [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7745)] [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:19:28.174752 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 04:19:28.201185 run osmo-hlr_10.42.42.2(pid=7742): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7742)] 04:19:28.249269 run osmo-hlr_10.42.42.2(pid=7742): stdout: | (launched: 2022-12-14_04:19:25.107554) 04:19:28.298547 run osmo-hlr_10.42.42.2(pid=7742): stderr: | [0;m[1;31m20221214041925281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041925282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041925282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041925282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041925282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041925282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041925294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041925303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041925303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041925303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:28.348124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7741): Terminating (SIGTERM) 04:19:28.387514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7744): Terminating (SIGTERM) 04:19:28.426773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7747): Terminating (SIGTERM) 04:19:28.465999 --- ParallelTerminationStrategy: PID 7741 died... 04:19:28.484217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7741): Terminated: ok {rc=0} 04:19:28.527582 --- ParallelTerminationStrategy: PID 7744 died... 04:19:28.545847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7744): Terminated: ok {rc=0} 04:19:28.588858 --- ParallelTerminationStrategy: PID 7747 died... 04:19:28.607103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7747): Terminated: ok {rc=0} 04:19:28.691920 bus /gobi_0: Setting Powered False 04:19:29.794331 bus /gobi_0: Setting Powered False 04:19:30.930708 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:19:32.211037 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:32.217248 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:19:32.250998 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:19:32.289827 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:19:32.346116 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:19:32.379178 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:19:32.414537 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:19:32.967729 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:19:32.973921 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:32.985257 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:19:33.053064 tst switch_tch_pdch.py: using LAC 38499 04:19:33.166605 tst switch_tch_pdch.py: using RAC 249 04:19:33.282965 tst switch_tch_pdch.py: using CellId 38499 04:19:33.406954 tst switch_tch_pdch.py: using BVCI 38500 04:19:33.521646 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.533185 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.544281 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.555468 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.567028 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.578488 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.590417 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:19:33.601901 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:19:33.718615 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:19:33.837679 tst switch_tch_pdch.py:51: start network... 04:19:34.048484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:34.509074 run create_hlr_db(pid=7753): Launched 04:19:34.629199 bus /gobi_6: Setting Powered False 04:19:35.691601 run create_hlr_db(pid=7753): Terminated: ok {rc=0} 04:19:36.089392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Launched 04:19:36.384412 run osmo-hlr_10.42.42.2(pid=7756): Launched 04:19:36.495987 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:36.997576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Launched 04:19:37.293294 run osmo-stp_10.42.42.5(pid=7759): Launched 04:19:37.406608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:19:37.890574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7761): Launched 04:19:38.002975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:19:38.251618 run patchelf(pid=7762): Launched 04:19:38.415030 run osmo-stp_10.42.42.5(pid=7759): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] 04:19:38.539822 run osmo-stp_10.42.42.5(pid=7759): stdout: | (launched: 2022-12-14_04:19:37.237601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:38.666275 run osmo-stp_10.42.42.5(pid=7759): stderr: | [0;m[38;5;43m20221214041937408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041937408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041937409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041937409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:38.793194 run osmo-stp_10.42.42.5(pid=7759): stdout: | (launched: 2022-12-14_04:19:37.237601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:38.913798 run osmo-stp_10.42.42.5(pid=7759): stderr: | [0;m[38;5;43m20221214041937408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041937408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041937409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041937409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041937410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:39.056445 run patchelf(pid=7762): Terminating (SIGINT) 04:19:39.221473 run patchelf(pid=7762): Terminated: ok {rc=0} 04:19:39.340701 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7759): Process ended prematurely: osmo-stp_10.42.42.5(pid=7759) [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:19:39.349919 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 04:19:39.376199 run osmo-hlr_10.42.42.2(pid=7756): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7756)] 04:19:39.423689 run osmo-hlr_10.42.42.2(pid=7756): stdout: | (launched: 2022-12-14_04:19:36.328830) 04:19:39.472878 run osmo-hlr_10.42.42.2(pid=7756): stderr: | [0;m[1;31m20221214041936503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041936504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041936504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041936504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041936504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041936504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041936516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041936525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041936525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041936525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:39.522655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Terminating (SIGTERM) 04:19:39.561938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Terminating (SIGTERM) 04:19:39.601309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7761): Terminating (SIGTERM) 04:19:39.641547 --- ParallelTerminationStrategy: PID 7755 died... 04:19:39.660534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7755): Terminated: ok {rc=0} 04:19:39.704270 --- ParallelTerminationStrategy: PID 7758 died... 04:19:39.722918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7758): Terminated: ok {rc=0} 04:19:39.766281 --- ParallelTerminationStrategy: PID 7761 died... 04:19:39.784874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7761): Terminated: ok {rc=0} 04:19:39.870945 bus /gobi_0: Setting Powered False 04:19:40.969901 bus /gobi_0: Setting Powered False 04:19:42.084159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:trx-lms --------------------------------------------------------------------- 04:19:43.333087 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:43.336829 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:43.370343 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:19:43.377162 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:19:43.428771 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:43.461778 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:19:43.468508 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:19:44.006204 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:19:44.011271 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 04:19:44.022131 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 04:19:44.071715 tst mo_mt_sms.py: using LAC 38500 04:19:44.186033 tst mo_mt_sms.py: using RAC 250 04:19:44.299348 tst mo_mt_sms.py: using CellId 38500 04:19:44.412540 tst mo_mt_sms.py: using BVCI 38501 04:19:44.518200 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:44.635102 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:44.748868 tst mo_mt_sms.py:9: start nitb and bts... 04:19:44.945560 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:19:45.546562 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7766): Launched 04:19:45.855598 run osmo-nitb_10.42.42.2(pid=7767): Launched 04:19:46.039061 run osmo-nitb_10.42.42.2(pid=7767): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7767)] 04:19:46.173979 run osmo-nitb_10.42.42.2(pid=7767): stdout: | (launched: 2022-12-14_04:19:45.785964) 04:19:46.310658 run osmo-nitb_10.42.42.2(pid=7767): stderr: | (launched: 2022-12-14_04:19:45.829617) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:46.447242 run osmo-nitb_10.42.42.2(pid=7767): stdout: | (launched: 2022-12-14_04:19:45.785964) 04:19:46.577650 run osmo-nitb_10.42.42.2(pid=7767): stderr: | (launched: 2022-12-14_04:19:45.829617) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7767) [trial-2399↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7767)] 04:19:46.985940 tst osmo-nitb_10.42.42.2(pid=7767): stdout: | (launched: 2022-12-14_04:19:45.785964) 04:19:47.116372 tst osmo-nitb_10.42.42.2(pid=7767): stderr: | (launched: 2022-12-14_04:19:45.829617) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:19:47.269388 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7767) [trial-2399↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7767)] [trial-2399↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 04:19:47.278681 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 04:19:47.285905 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7766): Terminating (SIGTERM) 04:19:47.498379 --- ParallelTerminationStrategy: PID 7766 died... 04:19:47.519553 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7766): Terminated: ok {rc=0} 04:19:47.609995 bus /sierra_3: Setting Powered False 04:19:48.710380 bus /sierra_3: Setting Powered False 04:19:49.827315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:trx-lms --------------------------------------------------------------------- 04:19:51.026163 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:19:51.030548 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 04:19:51.063716 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:19:51.091763 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 04:19:51.145429 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 04:19:51.178421 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:19:51.205129 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 04:19:51.750121 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 04:19:51.755318 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:51.765901 tst sms:trx-lms: Using 1 x bts (candidates: 1) 04:19:51.814326 tst mo_mt_sms.py: using LAC 38501 04:19:51.939116 tst mo_mt_sms.py: using RAC 251 04:19:52.062903 tst mo_mt_sms.py: using CellId 38501 04:19:52.186680 tst mo_mt_sms.py: using BVCI 38502 04:19:52.301052 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:52.312052 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:52.323031 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:52.333785 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:52.345189 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 04:19:52.356422 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:52.471939 tst sms:trx-lms: Using 1 x modem (candidates: 2) 04:19:52.594260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:19:53.085513 run create_hlr_db(pid=7771): Launched 04:19:53.205696 bus /sierra_2: Setting Powered False 04:19:54.268250 run create_hlr_db(pid=7771): Terminated: ok {rc=0} 04:19:54.694291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Launched 04:19:54.989398 run osmo-hlr_10.42.42.2(pid=7775): Launched 04:19:55.101556 run osmo-stp_10.42.42.5: Starting osmo-stp 04:19:55.628114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Launched 04:19:55.922958 run osmo-stp_10.42.42.5(pid=7778): Launched 04:19:56.034097 run osmo-msc_10.42.42.6: Starting osmo-msc 04:19:56.568102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Launched 04:19:56.862944 run osmo-msc_10.42.42.6(pid=7781): Launched 04:19:57.026994 run osmo-stp_10.42.42.5(pid=7778): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] 04:19:57.152256 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-14_04:19:55.867962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:57.276767 run osmo-stp_10.42.42.5(pid=7778): stderr: | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041956037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:57.399190 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-14_04:19:55.867962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:19:57.516651 run osmo-stp_10.42.42.5(pid=7778): stderr: | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214041956036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214041956037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214041956037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:19:57.655995 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2399↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] [trial-2399↪sms:trx-lms↪mo_mt_sms.py:16] 04:19:57.664648 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:19:57.690583 run osmo-hlr_10.42.42.2(pid=7775): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7775)] 04:19:57.738161 run osmo-hlr_10.42.42.2(pid=7775): stdout: | (launched: 2022-12-14_04:19:54.934284) 04:19:57.787344 run osmo-hlr_10.42.42.2(pid=7775): stderr: | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214041955109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214041955122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214041955132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214041955133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214041955133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:19:57.855694 run osmo-msc_10.42.42.6(pid=7781): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7781)] 04:19:57.903672 run osmo-msc_10.42.42.6(pid=7781): stdout: | (launched: 2022-12-14_04:19:56.807699) 04:19:57.952568 run osmo-msc_10.42.42.6(pid=7781): stderr: | [0;m[38;5;43m20221214041957076 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214041957076 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e53df4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214041957076 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214041957076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214041957076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214041957077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214041957078 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214041957079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214041957079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214041957079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:19:58.002067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminating (SIGTERM) 04:19:58.041378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminating (SIGTERM) 04:19:58.080659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminating (SIGTERM) 04:19:58.120102 --- ParallelTerminationStrategy: PID 7774 died... 04:19:58.138920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminated: ok {rc=0} 04:19:58.182347 --- ParallelTerminationStrategy: PID 7777 died... 04:19:58.200659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminated: ok {rc=0} 04:19:58.243919 --- ParallelTerminationStrategy: PID 7780 died... 04:19:58.262237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminated: ok {rc=0} 04:19:58.347143 bus /sierra_3: Setting Powered False 04:19:59.444828 bus /sierra_3: Setting Powered False 04:20:00.558108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-lms --------------------------------------------------------------------- 04:20:01.820207 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:01.825767 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:20:01.861699 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 04:20:01.870460 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:20:01.913306 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:20:01.975583 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 04:20:01.985919 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:20:02.467621 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 04:20:02.472486 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 04:20:02.483221 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 04:20:02.529841 tst assert_extension.py: using LAC 38502 04:20:02.646015 tst assert_extension.py: using RAC 252 04:20:02.771279 tst assert_extension.py: using CellId 38502 04:20:02.887822 tst assert_extension.py: using BVCI 38503 04:20:02.994690 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 04:20:03.111423 tst assert_extension.py:10: start nitb and bts... 04:20:03.323875 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:20:03.972354 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7789): Launched 04:20:04.289704 run osmo-nitb_10.42.42.2(pid=7790): Launched 04:20:04.466156 run osmo-nitb_10.42.42.2(pid=7790): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7790)] 04:20:04.610288 run osmo-nitb_10.42.42.2(pid=7790): stdout: | (launched: 2022-12-14_04:20:04.230670) 04:20:04.755148 run osmo-nitb_10.42.42.2(pid=7790): stderr: | (launched: 2022-12-14_04:20:04.277840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:20:04.899961 run osmo-nitb_10.42.42.2(pid=7790): stdout: | (launched: 2022-12-14_04:20:04.230670) 04:20:05.038502 run osmo-nitb_10.42.42.2(pid=7790): stderr: | (launched: 2022-12-14_04:20:04.277840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7790) [trial-2399↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7790)] 04:20:05.409601 tst osmo-nitb_10.42.42.2(pid=7790): stdout: | (launched: 2022-12-14_04:20:04.230670) 04:20:05.538587 tst osmo-nitb_10.42.42.2(pid=7790): stderr: | (launched: 2022-12-14_04:20:04.277840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:20:05.690613 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7790) [trial-2399↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7790)] [trial-2399↪nitb_ussd:trx-lms↪assert_extension.py:12] 04:20:05.699727 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:20:05.706854 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7789): Terminating (SIGTERM) 04:20:05.919057 --- ParallelTerminationStrategy: PID 7789 died... 04:20:05.940626 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7789): Terminated: ok {rc=0} 04:20:06.030893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:trx-lms --------------------------------------------------------------------- 04:20:07.208327 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:07.212486 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 04:20:07.245555 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:20:07.272801 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 04:20:07.308519 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 04:20:07.341248 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:20:07.367386 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 04:20:07.896315 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:trx-lms assert_extension.py ---------------------------------------------- 04:20:07.901526 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:07.911929 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 04:20:07.959919 tst assert_extension.py: using LAC 38503 04:20:08.075107 tst assert_extension.py: using RAC 253 04:20:08.204167 tst assert_extension.py: using CellId 38503 04:20:08.326875 tst assert_extension.py: using BVCI 38504 04:20:08.443721 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:08.454709 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:08.465758 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:08.476689 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:08.487940 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 04:20:08.499118 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 04:20:08.613967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:09.074061 run create_hlr_db(pid=7794): Launched 04:20:09.195561 bus /sierra_2: Setting Powered False 04:20:10.255510 run create_hlr_db(pid=7794): Terminated: ok {rc=0} 04:20:10.691326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7796): Launched 04:20:11.008682 run osmo-hlr_10.42.42.2(pid=7797): Launched 04:20:11.129590 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:11.677693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7799): Launched 04:20:11.994291 run osmo-stp_10.42.42.5(pid=7800): Launched 04:20:12.116810 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:12.687940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7802): Launched 04:20:13.003933 run osmo-msc_10.42.42.6(pid=7803): Launched 04:20:13.180531 run osmo-stp_10.42.42.5(pid=7800): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7800)] 04:20:13.318844 run osmo-stp_10.42.42.5(pid=7800): stdout: | (launched: 2022-12-14_04:20:11.935561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:13.454312 run osmo-stp_10.42.42.5(pid=7800): stderr: | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042012128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:13.588263 run osmo-stp_10.42.42.5(pid=7800): stdout: | (launched: 2022-12-14_04:20:11.935561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:13.714910 run osmo-stp_10.42.42.5(pid=7800): stderr: | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042012127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042012128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042012128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:13.865329 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7800): Process ended prematurely: osmo-stp_10.42.42.5(pid=7800) [trial-2399↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7800)] [trial-2399↪ussd:trx-lms↪assert_extension.py:17] 04:20:13.874553 tst assert_extension.py:17: Test FAILED (6.0 sec) 04:20:13.901988 run osmo-hlr_10.42.42.2(pid=7797): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7797)] 04:20:13.952915 run osmo-hlr_10.42.42.2(pid=7797): stdout: | (launched: 2022-12-14_04:20:10.949998) 04:20:14.005316 run osmo-hlr_10.42.42.2(pid=7797): stderr: | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042011146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042011159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042011167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042011167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042011167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:14.078131 run osmo-msc_10.42.42.6(pid=7803): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7803)] 04:20:14.128394 run osmo-msc_10.42.42.6(pid=7803): stdout: | (launched: 2022-12-14_04:20:12.945186) 04:20:14.180522 run osmo-msc_10.42.42.6(pid=7803): stderr: | [0;m[38;5;43m20221214042013265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042013265 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc71c361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042013265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042013266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042013266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042013266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042013267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042013268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042013268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042013268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:14.233353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7796): Terminating (SIGTERM) 04:20:14.275504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7799): Terminating (SIGTERM) 04:20:14.317814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7802): Terminating (SIGTERM) 04:20:14.360290 --- ParallelTerminationStrategy: PID 7796 died... 04:20:14.380783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7796): Terminated: ok {rc=0} 04:20:14.427826 --- ParallelTerminationStrategy: PID 7799 died... 04:20:14.447743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7799): Terminated: ok {rc=0} 04:20:14.494071 --- ParallelTerminationStrategy: PID 7802 died... 04:20:14.514170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7802): Terminated: ok {rc=0} 04:20:14.603063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:20:15.813352 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:15.820380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:20:15.859079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:20:15.887288 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:20:15.962439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:20:15.997831 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:20:16.034092 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:20:16.571011 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:20:16.645973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:16.661256 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:20:16.749310 tst mo_mt_call.py: using LAC 38504 04:20:16.869405 tst mo_mt_call.py: using RAC 254 04:20:17.018173 tst mo_mt_call.py: using CellId 38504 04:20:17.140872 tst mo_mt_call.py: using BVCI 38505 04:20:17.252784 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:17.264908 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:17.276923 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:17.288796 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:17.301794 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:17.315053 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:17.432597 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:17.551859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:18.018954 run create_hlr_db(pid=7808): Launched 04:20:18.142657 bus /sierra_2: Setting Powered False 04:20:19.202396 run create_hlr_db(pid=7808): Terminated: ok {rc=0} 04:20:19.643452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Launched 04:20:19.966613 run osmo-hlr_10.42.42.2(pid=7811): Launched 04:20:20.089379 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:20.647769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Launched 04:20:20.971018 run osmo-stp_10.42.42.5(pid=7814): Launched 04:20:21.094660 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:21.678394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7816): Launched 04:20:22.000829 run osmo-msc_10.42.42.6(pid=7817): Launched 04:20:22.180583 run osmo-stp_10.42.42.5(pid=7814): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] 04:20:22.317182 run osmo-stp_10.42.42.5(pid=7814): stdout: | (launched: 2022-12-14_04:20:20.911013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:22.454578 run osmo-stp_10.42.42.5(pid=7814): stderr: | [0;m[38;5;43m20221214042021102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042021103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042021103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042021103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:22.590263 run osmo-stp_10.42.42.5(pid=7814): stdout: | (launched: 2022-12-14_04:20:20.911013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:22.718452 run osmo-stp_10.42.42.5(pid=7814): stderr: | [0;m[38;5;43m20221214042021102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042021103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042021103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042021103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042021104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:22.871772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7814): Process ended prematurely: osmo-stp_10.42.42.5(pid=7814) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:20:22.881594 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:20:22.909467 run osmo-hlr_10.42.42.2(pid=7811): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7811)] 04:20:22.960373 run osmo-hlr_10.42.42.2(pid=7811): stdout: | (launched: 2022-12-14_04:20:19.906710) 04:20:23.012499 run osmo-hlr_10.42.42.2(pid=7811): stderr: | [0;m[1;31m20221214042020104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042020104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042020104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042020104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042020104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042020105 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042020117 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042020125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042020125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042020125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:23.085220 run osmo-msc_10.42.42.6(pid=7817): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7817)] 04:20:23.135321 run osmo-msc_10.42.42.6(pid=7817): stdout: | (launched: 2022-12-14_04:20:21.941090) 04:20:23.187211 run osmo-msc_10.42.42.6(pid=7817): stderr: | [0;m[38;5;43m20221214042022261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042022261 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff477568c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042022261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042022261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042022261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042022261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042022263 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042022263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042022263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042022264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:23.239490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Terminating (SIGTERM) 04:20:23.281600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Terminating (SIGTERM) 04:20:23.323804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7816): Terminating (SIGTERM) 04:20:23.365890 --- ParallelTerminationStrategy: PID 7810 died... 04:20:23.386200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7810): Terminated: ok {rc=0} 04:20:23.432722 --- ParallelTerminationStrategy: PID 7813 died... 04:20:23.452622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7813): Terminated: ok {rc=0} 04:20:23.499554 --- ParallelTerminationStrategy: PID 7816 died... 04:20:23.519731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7816): Terminated: ok {rc=0} 04:20:23.607958 bus /sierra_3: Setting Powered False 04:20:24.708690 bus /sierra_3: Setting Powered False 04:20:25.825269 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:20:26.973450 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:26.985586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:20:27.058042 tst mo_mt_call_osmux.py: using LAC 38505 04:20:27.177764 tst mo_mt_call_osmux.py: using RAC 255 04:20:27.296207 tst mo_mt_call_osmux.py: using CellId 38505 04:20:27.416508 tst mo_mt_call_osmux.py: using BVCI 38506 04:20:27.527625 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.538840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.549961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.560806 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.572704 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:20:27.584172 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:27.704757 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:20:27.827383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:28.293879 run create_hlr_db(pid=7819): Launched 04:20:28.416830 bus /sierra_2: Setting Powered False 04:20:29.477641 run create_hlr_db(pid=7819): Terminated: ok {rc=0} 04:20:29.919730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7821): Launched 04:20:30.243987 run osmo-hlr_10.42.42.2(pid=7822): Launched 04:20:30.368596 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:30.957812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7824): Launched 04:20:31.281956 run osmo-stp_10.42.42.5(pid=7825): Launched 04:20:31.575112 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:32.220163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7827): Launched 04:20:32.531556 run osmo-msc_10.42.42.6(pid=7828): Launched 04:20:32.700510 run osmo-stp_10.42.42.5(pid=7825): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7825)] 04:20:32.827723 run osmo-stp_10.42.42.5(pid=7825): stdout: | (launched: 2022-12-14_04:20:31.222175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:32.954714 run osmo-stp_10.42.42.5(pid=7825): stderr: | [0;m[38;5;43m20221214042031506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042031507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042031507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042031507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:33.080255 run osmo-stp_10.42.42.5(pid=7825): stdout: | (launched: 2022-12-14_04:20:31.222175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:33.199648 run osmo-stp_10.42.42.5(pid=7825): stderr: | [0;m[38;5;43m20221214042031506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042031507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042031507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042031507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042031508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:33.342824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7825): Process ended prematurely: osmo-stp_10.42.42.5(pid=7825) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7825)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:20:33.351988 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:20:33.378455 run osmo-hlr_10.42.42.2(pid=7822): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7822)] 04:20:33.426255 run osmo-hlr_10.42.42.2(pid=7822): stdout: | (launched: 2022-12-14_04:20:30.183856) 04:20:33.475659 run osmo-hlr_10.42.42.2(pid=7822): stderr: | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042030381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042030392 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042030400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042030401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042030401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:33.544705 run osmo-msc_10.42.42.6(pid=7828): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7828)] 04:20:33.592714 run osmo-msc_10.42.42.6(pid=7828): stdout: | (launched: 2022-12-14_04:20:32.475271) 04:20:33.642251 run osmo-msc_10.42.42.6(pid=7828): stderr: | [0;m[38;5;43m20221214042032748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042032748 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe021084c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042032748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042032748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042032748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042032749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042032751 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042032751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042032751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042032751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:33.691799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7821): Terminating (SIGTERM) 04:20:33.731762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7824): Terminating (SIGTERM) 04:20:33.772126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7827): Terminating (SIGTERM) 04:20:33.812158 --- ParallelTerminationStrategy: PID 7821 died... 04:20:33.831484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7821): Terminated: ok {rc=0} 04:20:33.875682 --- ParallelTerminationStrategy: PID 7824 died... 04:20:33.894518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7824): Terminated: ok {rc=0} 04:20:33.938505 --- ParallelTerminationStrategy: PID 7827 died... 04:20:33.957220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7827): Terminated: ok {rc=0} 04:20:34.043652 bus /sierra_3: Setting Powered False 04:20:35.144570 bus /sierra_3: Setting Powered False 04:20:36.259193 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:20:37.512800 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:37.520317 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:20:37.554134 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:20:37.583166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:20:37.636022 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:20:37.669294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:20:37.696725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:20:38.249923 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:20:38.302847 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.314563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:20:38.385706 tst mo_mt_call.py: using LAC 38506 04:20:38.509693 tst mo_mt_call.py: using RAC 1 04:20:38.628598 tst mo_mt_call.py: using CellId 38506 04:20:38.748933 tst mo_mt_call.py: using BVCI 38507 04:20:38.859980 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.871251 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.882473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.893600 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.905262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:38.916904 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:39.037427 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:39.157302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:39.657518 run create_hlr_db(pid=7833): Launched 04:20:39.782444 bus /sierra_2: Setting Powered False 04:20:40.846423 run create_hlr_db(pid=7833): Terminated: ok {rc=0} 04:20:41.277264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7835): Launched 04:20:41.578529 run osmo-hlr_10.42.42.2(pid=7836): Launched 04:20:41.692652 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:42.254256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7838): Launched 04:20:42.555002 run osmo-stp_10.42.42.5(pid=7839): Launched 04:20:42.670221 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:43.214936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7841): Launched 04:20:43.515635 run osmo-msc_10.42.42.6(pid=7842): Launched 04:20:43.683841 run osmo-stp_10.42.42.5(pid=7839): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7839)] 04:20:43.811916 run osmo-stp_10.42.42.5(pid=7839): stdout: | (launched: 2022-12-14_04:20:42.498317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:43.939778 run osmo-stp_10.42.42.5(pid=7839): stderr: | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042042675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:44.065297 run osmo-stp_10.42.42.5(pid=7839): stdout: | (launched: 2022-12-14_04:20:42.498317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:44.184295 run osmo-stp_10.42.42.5(pid=7839): stderr: | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042042674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042042675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042042675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:44.326618 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7839): Process ended prematurely: osmo-stp_10.42.42.5(pid=7839) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7839)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:20:44.335668 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:20:44.362174 run osmo-hlr_10.42.42.2(pid=7836): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7836)] 04:20:44.410369 run osmo-hlr_10.42.42.2(pid=7836): stdout: | (launched: 2022-12-14_04:20:41.522264) 04:20:44.459724 run osmo-hlr_10.42.42.2(pid=7836): stderr: | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042041698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042041710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042041721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042041721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042041721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:44.528380 run osmo-msc_10.42.42.6(pid=7842): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7842)] 04:20:44.576286 run osmo-msc_10.42.42.6(pid=7842): stdout: | (launched: 2022-12-14_04:20:43.458734) 04:20:44.625477 run osmo-msc_10.42.42.6(pid=7842): stderr: | [0;m[38;5;43m20221214042043732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042043732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd050a1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042043732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042043732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042043733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042043733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042043735 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042043735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042043735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042043735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:44.674969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7835): Terminating (SIGTERM) 04:20:44.714611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7838): Terminating (SIGTERM) 04:20:44.754189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7841): Terminating (SIGTERM) 04:20:44.793782 --- ParallelTerminationStrategy: PID 7835 died... 04:20:44.813050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7835): Terminated: ok {rc=0} 04:20:44.857116 --- ParallelTerminationStrategy: PID 7838 died... 04:20:44.875761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7838): Terminated: ok {rc=0} 04:20:44.919475 --- ParallelTerminationStrategy: PID 7841 died... 04:20:44.938151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7841): Terminated: ok {rc=0} 04:20:45.024090 bus /sierra_3: Setting Powered False 04:20:46.126767 bus /sierra_3: Setting Powered False 04:20:47.244846 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:20:48.393954 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.406303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:20:48.478233 tst mo_mt_call_osmux.py: using LAC 38507 04:20:48.608068 tst mo_mt_call_osmux.py: using RAC 2 04:20:48.734235 tst mo_mt_call_osmux.py: using CellId 38507 04:20:48.858646 tst mo_mt_call_osmux.py: using BVCI 38508 04:20:48.976039 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.987580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:48.998955 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:49.010248 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:49.022154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:20:49.033810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:49.155178 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:20:49.270828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:20:49.738620 run create_hlr_db(pid=7844): Launched 04:20:49.861775 bus /sierra_2: Setting Powered False 04:20:50.921175 run create_hlr_db(pid=7844): Terminated: ok {rc=0} 04:20:51.342492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7846): Launched 04:20:51.644174 run osmo-hlr_10.42.42.2(pid=7847): Launched 04:20:51.758071 run osmo-stp_10.42.42.5: Starting osmo-stp 04:20:52.321816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Launched 04:20:52.646911 run osmo-stp_10.42.42.5(pid=7852): Launched 04:20:52.769967 run osmo-msc_10.42.42.6: Starting osmo-msc 04:20:53.356484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7854): Launched 04:20:53.681745 run osmo-msc_10.42.42.6(pid=7855): Launched 04:20:53.861895 run osmo-stp_10.42.42.5(pid=7852): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] 04:20:53.998778 run osmo-stp_10.42.42.5(pid=7852): stdout: | (launched: 2022-12-14_04:20:52.586976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:54.136585 run osmo-stp_10.42.42.5(pid=7852): stderr: | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042052781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:54.274206 run osmo-stp_10.42.42.5(pid=7852): stdout: | (launched: 2022-12-14_04:20:52.586976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:20:54.403843 run osmo-stp_10.42.42.5(pid=7852): stderr: | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042052780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042052781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042052781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:20:54.559421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7852): Process ended prematurely: osmo-stp_10.42.42.5(pid=7852) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:20:54.569369 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:20:54.597483 run osmo-hlr_10.42.42.2(pid=7847): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7847)] 04:20:54.648658 run osmo-hlr_10.42.42.2(pid=7847): stdout: | (launched: 2022-12-14_04:20:51.587344) 04:20:54.701523 run osmo-hlr_10.42.42.2(pid=7847): stderr: | [0;m[1;31m20221214042051765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042051765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042051765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042051765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042051766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042051766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042051777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042051786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042051786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042051786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:20:54.774714 run osmo-msc_10.42.42.6(pid=7855): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7855)] 04:20:54.825292 run osmo-msc_10.42.42.6(pid=7855): stdout: | (launched: 2022-12-14_04:20:53.621417) 04:20:54.877796 run osmo-msc_10.42.42.6(pid=7855): stderr: | [0;m[38;5;43m20221214042053945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042053945 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa75e471c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042053945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042053946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042053946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042053946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042053947 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042053948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042053948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042053948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:20:54.930377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7846): Terminating (SIGTERM) 04:20:54.972414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Terminating (SIGTERM) 04:20:55.014925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7854): Terminating (SIGTERM) 04:20:55.057488 --- ParallelTerminationStrategy: PID 7846 died... 04:20:55.078291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7846): Terminated: ok {rc=0} 04:20:55.125482 --- ParallelTerminationStrategy: PID 7851 died... 04:20:55.145691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7851): Terminated: ok {rc=0} 04:20:55.192623 --- ParallelTerminationStrategy: PID 7854 died... 04:20:55.212746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7854): Terminated: ok {rc=0} 04:20:55.302642 bus /sierra_3: Setting Powered False 04:20:56.399526 bus /sierra_3: Setting Powered False 04:20:57.515670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:20:58.765233 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:20:58.771917 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:20:58.804577 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:20:58.831227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:20:58.883882 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:20:58.918171 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:20:58.945424 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:20:59.492555 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:20:59.541641 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:20:59.552865 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:20:59.622669 tst mo_mt_call.py: using LAC 38508 04:20:59.743794 tst mo_mt_call.py: using RAC 3 04:20:59.865689 tst mo_mt_call.py: using CellId 38508 04:20:59.984335 tst mo_mt_call.py: using BVCI 38509 04:21:00.093431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:00.104425 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:00.115250 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:00.126033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:00.137406 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:00.148824 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:00.266066 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:00.389019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:00.919099 run create_hlr_db(pid=7860): Launched 04:21:01.092275 bus /sierra_2: Setting Powered False 04:21:02.161596 run create_hlr_db(pid=7860): Terminated: ok {rc=0} 04:21:02.595621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7862): Launched 04:21:02.898413 run osmo-hlr_10.42.42.2(pid=7863): Launched 04:21:03.014053 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:03.533326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7865): Launched 04:21:03.836306 run osmo-stp_10.42.42.5(pid=7866): Launched 04:21:03.951004 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:04.497463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7868): Launched 04:21:04.800425 run osmo-msc_10.42.42.6(pid=7869): Launched 04:21:04.968679 run osmo-stp_10.42.42.5(pid=7866): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7866)] 04:21:05.095921 run osmo-stp_10.42.42.5(pid=7866): stdout: | (launched: 2022-12-14_04:21:03.779279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:05.223278 run osmo-stp_10.42.42.5(pid=7866): stderr: | [0;m[38;5;43m20221214042103952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042103953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042103953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042103953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:05.348678 run osmo-stp_10.42.42.5(pid=7866): stdout: | (launched: 2022-12-14_04:21:03.779279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:05.467895 run osmo-stp_10.42.42.5(pid=7866): stderr: | [0;m[38;5;43m20221214042103952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042103953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042103953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042103953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042103954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:05.610676 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7866): Process ended prematurely: osmo-stp_10.42.42.5(pid=7866) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7866)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:21:05.619674 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:21:05.646114 run osmo-hlr_10.42.42.2(pid=7863): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7863)] 04:21:05.693883 run osmo-hlr_10.42.42.2(pid=7863): stdout: | (launched: 2022-12-14_04:21:02.841684) 04:21:05.743162 run osmo-hlr_10.42.42.2(pid=7863): stderr: | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042103018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042103079 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042103089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042103090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042103090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:05.812324 run osmo-msc_10.42.42.6(pid=7869): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7869)] 04:21:05.859722 run osmo-msc_10.42.42.6(pid=7869): stdout: | (launched: 2022-12-14_04:21:04.743782) 04:21:05.908891 run osmo-msc_10.42.42.6(pid=7869): stderr: | [0;m[38;5;43m20221214042105014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042105014 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90e2331c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042105014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042105014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042105015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042105015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042105016 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042105017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042105017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042105017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:05.958552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7862): Terminating (SIGTERM) 04:21:05.998268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7865): Terminating (SIGTERM) 04:21:06.037901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7868): Terminating (SIGTERM) 04:21:06.077969 --- ParallelTerminationStrategy: PID 7862 died... 04:21:06.097079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7862): Terminated: ok {rc=0} 04:21:06.141055 --- ParallelTerminationStrategy: PID 7865 died... 04:21:06.159831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7865): Terminated: ok {rc=0} 04:21:06.203249 --- ParallelTerminationStrategy: PID 7868 died... 04:21:06.221900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7868): Terminated: ok {rc=0} 04:21:06.308772 bus /sierra_3: Setting Powered False 04:21:07.408611 bus /sierra_3: Setting Powered False 04:21:08.525088 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:21:09.678521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:09.690976 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:21:09.763582 tst mo_mt_call_osmux.py: using LAC 38509 04:21:09.884216 tst mo_mt_call_osmux.py: using RAC 4 04:21:10.012520 tst mo_mt_call_osmux.py: using CellId 38509 04:21:10.140062 tst mo_mt_call_osmux.py: using BVCI 38510 04:21:10.257932 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.269701 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.281261 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.292444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.304102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:21:10.315802 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:10.431809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:21:10.552799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:11.054674 run create_hlr_db(pid=7871): Launched 04:21:11.177948 bus /sierra_2: Setting Powered False 04:21:12.241388 run create_hlr_db(pid=7871): Terminated: ok {rc=0} 04:21:12.692420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7873): Launched 04:21:13.016740 run osmo-hlr_10.42.42.2(pid=7874): Launched 04:21:13.140481 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:13.699251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7876): Launched 04:21:14.022603 run osmo-stp_10.42.42.5(pid=7877): Launched 04:21:14.145490 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:14.730145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7879): Launched 04:21:15.053374 run osmo-msc_10.42.42.6(pid=7880): Launched 04:21:15.233451 run osmo-stp_10.42.42.5(pid=7877): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7877)] 04:21:15.369586 run osmo-stp_10.42.42.5(pid=7877): stdout: | (launched: 2022-12-14_04:21:13.962698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:15.507048 run osmo-stp_10.42.42.5(pid=7877): stderr: | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042114156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:15.643531 run osmo-stp_10.42.42.5(pid=7877): stdout: | (launched: 2022-12-14_04:21:13.962698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:15.771988 run osmo-stp_10.42.42.5(pid=7877): stderr: | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042114155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042114156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042114156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:15.928414 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7877): Process ended prematurely: osmo-stp_10.42.42.5(pid=7877) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7877)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:21:15.939096 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:21:15.968196 run osmo-hlr_10.42.42.2(pid=7874): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7874)] 04:21:16.021912 run osmo-hlr_10.42.42.2(pid=7874): stdout: | (launched: 2022-12-14_04:21:12.956456) 04:21:16.075779 run osmo-hlr_10.42.42.2(pid=7874): stderr: | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042113155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042113168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042113176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042113176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042113176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:16.152530 run osmo-msc_10.42.42.6(pid=7880): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7880)] 04:21:16.213739 run osmo-msc_10.42.42.6(pid=7880): stdout: | (launched: 2022-12-14_04:21:14.993349) 04:21:16.276822 run osmo-msc_10.42.42.6(pid=7880): stderr: | [0;m[38;5;43m20221214042115315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042115315 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b71618c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042115315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042115315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042115316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042115316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042115317 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042115318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042115318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042115318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:16.339619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7873): Terminating (SIGTERM) 04:21:16.390842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7876): Terminating (SIGTERM) 04:21:16.445770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7879): Terminating (SIGTERM) 04:21:16.498957 --- ParallelTerminationStrategy: PID 7873 died... 04:21:16.523511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7873): Terminated: ok {rc=0} 04:21:16.584763 --- ParallelTerminationStrategy: PID 7876 died... 04:21:16.608272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7876): Terminated: ok {rc=0} 04:21:16.665263 --- ParallelTerminationStrategy: PID 7879 died... 04:21:16.688816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7879): Terminated: ok {rc=0} 04:21:16.795888 bus /sierra_3: Setting Powered False 04:21:17.920578 bus /sierra_3: Setting Powered False 04:21:19.038014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:21:20.291013 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:20.297492 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:21:20.330364 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:21:20.357282 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:21:20.408891 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:21:20.442219 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:21:20.469538 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:21:21.021949 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:21:21.072718 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.084012 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:21:21.152293 tst mo_mt_call.py: using LAC 38510 04:21:21.268678 tst mo_mt_call.py: using RAC 5 04:21:21.385178 tst mo_mt_call.py: using CellId 38510 04:21:21.501571 tst mo_mt_call.py: using BVCI 38511 04:21:21.610744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.621850 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.632590 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.643343 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.654430 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:21.665582 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:21.784791 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:21.900664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:22.368450 run create_hlr_db(pid=7885): Launched 04:21:22.491962 bus /sierra_2: Setting Powered False 04:21:23.551356 run create_hlr_db(pid=7885): Terminated: ok {rc=0} 04:21:23.971743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7887): Launched 04:21:24.273846 run osmo-hlr_10.42.42.2(pid=7888): Launched 04:21:24.387878 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:24.928755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7890): Launched 04:21:25.231084 run osmo-stp_10.42.42.5(pid=7891): Launched 04:21:25.344911 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:25.888611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7893): Launched 04:21:26.190833 run osmo-msc_10.42.42.6(pid=7894): Launched 04:21:26.358794 run osmo-stp_10.42.42.5(pid=7891): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7891)] 04:21:26.485188 run osmo-stp_10.42.42.5(pid=7891): stdout: | (launched: 2022-12-14_04:21:25.174329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:26.611580 run osmo-stp_10.42.42.5(pid=7891): stderr: | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042125347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:26.736536 run osmo-stp_10.42.42.5(pid=7891): stdout: | (launched: 2022-12-14_04:21:25.174329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:26.855833 run osmo-stp_10.42.42.5(pid=7891): stderr: | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042125346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042125347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042125347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:26.998560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7891): Process ended prematurely: osmo-stp_10.42.42.5(pid=7891) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7891)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:21:27.007704 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:21:27.034600 run osmo-hlr_10.42.42.2(pid=7888): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7888)] 04:21:27.082925 run osmo-hlr_10.42.42.2(pid=7888): stdout: | (launched: 2022-12-14_04:21:24.217129) 04:21:27.132553 run osmo-hlr_10.42.42.2(pid=7888): stderr: | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042124396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042124408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042124417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042124417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042124418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:27.201559 run osmo-msc_10.42.42.6(pid=7894): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7894)] 04:21:27.249286 run osmo-msc_10.42.42.6(pid=7894): stdout: | (launched: 2022-12-14_04:21:26.133434) 04:21:27.298437 run osmo-msc_10.42.42.6(pid=7894): stderr: | [0;m[38;5;43m20221214042126408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042126408 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0a4410c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042126408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042126408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042126409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042126409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042126410 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042126411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042126411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042126411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:27.348023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7887): Terminating (SIGTERM) 04:21:27.387698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7890): Terminating (SIGTERM) 04:21:27.427287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7893): Terminating (SIGTERM) 04:21:27.467124 --- ParallelTerminationStrategy: PID 7887 died... 04:21:27.486591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7887): Terminated: ok {rc=0} 04:21:27.530779 --- ParallelTerminationStrategy: PID 7890 died... 04:21:27.549626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7890): Terminated: ok {rc=0} 04:21:27.593611 --- ParallelTerminationStrategy: PID 7893 died... 04:21:27.612550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7893): Terminated: ok {rc=0} 04:21:27.699104 bus /sierra_3: Setting Powered False 04:21:28.798982 bus /sierra_3: Setting Powered False 04:21:29.913503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:21:31.062691 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.076074 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:21:31.152774 tst mo_mt_call_osmux.py: using LAC 38511 04:21:31.322616 tst mo_mt_call_osmux.py: using RAC 6 04:21:31.482275 tst mo_mt_call_osmux.py: using CellId 38511 04:21:31.629877 tst mo_mt_call_osmux.py: using BVCI 38512 04:21:31.755107 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.767527 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.779781 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.792382 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.806394 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:21:31.819906 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:31.939359 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:21:32.084805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:32.606932 run create_hlr_db(pid=7896): Launched 04:21:32.731007 bus /sierra_2: Setting Powered False 04:21:33.794645 run create_hlr_db(pid=7896): Terminated: ok {rc=0} 04:21:34.245076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Launched 04:21:34.569069 run osmo-hlr_10.42.42.2(pid=7899): Launched 04:21:34.693724 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:35.252047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Launched 04:21:35.576508 run osmo-stp_10.42.42.5(pid=7902): Launched 04:21:35.699744 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:36.284483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7904): Launched 04:21:36.609165 run osmo-msc_10.42.42.6(pid=7905): Launched 04:21:36.788408 run osmo-stp_10.42.42.5(pid=7902): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] 04:21:36.924770 run osmo-stp_10.42.42.5(pid=7902): stdout: | (launched: 2022-12-14_04:21:35.516216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:37.062672 run osmo-stp_10.42.42.5(pid=7902): stderr: | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042135710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:37.199153 run osmo-stp_10.42.42.5(pid=7902): stdout: | (launched: 2022-12-14_04:21:35.516216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:37.327435 run osmo-stp_10.42.42.5(pid=7902): stderr: | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042135709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042135710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042135710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:37.481771 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7902): Process ended prematurely: osmo-stp_10.42.42.5(pid=7902) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:21:37.491649 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:21:37.519787 run osmo-hlr_10.42.42.2(pid=7899): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7899)] 04:21:37.570803 run osmo-hlr_10.42.42.2(pid=7899): stdout: | (launched: 2022-12-14_04:21:34.508232) 04:21:37.622897 run osmo-hlr_10.42.42.2(pid=7899): stderr: | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042134704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042134718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042134726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042134726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042134727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:37.695972 run osmo-msc_10.42.42.6(pid=7905): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7905)] 04:21:37.746237 run osmo-msc_10.42.42.6(pid=7905): stdout: | (launched: 2022-12-14_04:21:36.548852) 04:21:37.798223 run osmo-msc_10.42.42.6(pid=7905): stderr: | [0;m[38;5;43m20221214042136871 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042136871 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70d4193c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042136871 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042136871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042136871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042136872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042136873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042136874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042136874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042136874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:37.850387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Terminating (SIGTERM) 04:21:37.892335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Terminating (SIGTERM) 04:21:37.934860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7904): Terminating (SIGTERM) 04:21:37.977156 --- ParallelTerminationStrategy: PID 7898 died... 04:21:37.997387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7898): Terminated: ok {rc=0} 04:21:38.043779 --- ParallelTerminationStrategy: PID 7901 died... 04:21:38.063718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7901): Terminated: ok {rc=0} 04:21:38.110264 --- ParallelTerminationStrategy: PID 7904 died... 04:21:38.130316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7904): Terminated: ok {rc=0} 04:21:38.219050 bus /sierra_3: Setting Powered False 04:21:39.318629 bus /sierra_3: Setting Powered False 04:21:40.435515 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:21:41.695654 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:21:41.702749 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:21:41.736134 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:21:41.763515 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:21:41.816630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:21:41.850152 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:21:41.878144 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:21:42.426947 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:21:42.475660 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:42.486899 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:21:42.555960 tst mo_mt_call.py: using LAC 38512 04:21:42.674742 tst mo_mt_call.py: using RAC 7 04:21:42.798316 tst mo_mt_call.py: using CellId 38512 04:21:42.916795 tst mo_mt_call.py: using BVCI 38513 04:21:43.025600 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:43.036449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:43.047243 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:43.058026 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:43.068823 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:43.079592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:43.194942 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:43.310958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:43.776937 run create_hlr_db(pid=7910): Launched 04:21:43.899792 bus /sierra_2: Setting Powered False 04:21:44.960700 run create_hlr_db(pid=7910): Terminated: ok {rc=0} 04:21:45.401637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Launched 04:21:45.725945 run osmo-hlr_10.42.42.2(pid=7913): Launched 04:21:45.849344 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:46.541380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Launched 04:21:46.880730 run osmo-stp_10.42.42.5(pid=7916): Launched 04:21:47.151500 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:47.809753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7918): Launched 04:21:48.134306 run osmo-msc_10.42.42.6(pid=7919): Launched 04:21:48.313954 run osmo-stp_10.42.42.5(pid=7916): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] 04:21:48.450383 run osmo-stp_10.42.42.5(pid=7916): stdout: | (launched: 2022-12-14_04:21:46.817735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:48.587550 run osmo-stp_10.42.42.5(pid=7916): stderr: | [0;m[38;5;43m20221214042147198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042147199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042147199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042147199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:48.723716 run osmo-stp_10.42.42.5(pid=7916): stdout: | (launched: 2022-12-14_04:21:46.817735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:48.852374 run osmo-stp_10.42.42.5(pid=7916): stderr: | [0;m[38;5;43m20221214042147198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042147199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042147199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042147199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042147200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:49.006065 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7916): Process ended prematurely: osmo-stp_10.42.42.5(pid=7916) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:21:49.015763 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 04:21:49.043511 run osmo-hlr_10.42.42.2(pid=7913): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7913)] 04:21:49.094499 run osmo-hlr_10.42.42.2(pid=7913): stdout: | (launched: 2022-12-14_04:21:45.665820) 04:21:49.146642 run osmo-hlr_10.42.42.2(pid=7913): stderr: | [0;m[1;31m20221214042145910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042145910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042145911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042145911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042145911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042145911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042145931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042145944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042145944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042145944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:49.219253 run osmo-msc_10.42.42.6(pid=7919): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7919)] 04:21:49.269821 run osmo-msc_10.42.42.6(pid=7919): stdout: | (launched: 2022-12-14_04:21:48.074195) 04:21:49.322029 run osmo-msc_10.42.42.6(pid=7919): stderr: | [0;m[38;5;43m20221214042148396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042148396 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11256e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042148396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042148396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042148396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042148397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042148398 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042148399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042148399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042148399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:49.374635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Terminating (SIGTERM) 04:21:49.416600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Terminating (SIGTERM) 04:21:49.458426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7918): Terminating (SIGTERM) 04:21:49.500770 --- ParallelTerminationStrategy: PID 7912 died... 04:21:49.521110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7912): Terminated: ok {rc=0} 04:21:49.567477 --- ParallelTerminationStrategy: PID 7915 died... 04:21:49.587071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7915): Terminated: ok {rc=0} 04:21:49.633425 --- ParallelTerminationStrategy: PID 7918 died... 04:21:49.653242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7918): Terminated: ok {rc=0} 04:21:49.740418 bus /sierra_3: Setting Powered False 04:21:50.839129 bus /sierra_3: Setting Powered False 04:21:51.955784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:21:53.102275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.114144 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:21:53.183031 tst mo_mt_call_osmux.py: using LAC 38513 04:21:53.301082 tst mo_mt_call_osmux.py: using RAC 8 04:21:53.420663 tst mo_mt_call_osmux.py: using CellId 38513 04:21:53.540232 tst mo_mt_call_osmux.py: using BVCI 38514 04:21:53.650558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.661780 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.672556 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.683321 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.694275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:21:53.705238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:53.826929 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:21:53.944734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:21:54.413555 run create_hlr_db(pid=7921): Launched 04:21:54.536405 bus /sierra_2: Setting Powered False 04:21:55.597229 run create_hlr_db(pid=7921): Terminated: ok {rc=0} 04:21:56.039307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7923): Launched 04:21:56.362056 run osmo-hlr_10.42.42.2(pid=7924): Launched 04:21:56.487350 run osmo-stp_10.42.42.5: Starting osmo-stp 04:21:57.047918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7926): Launched 04:21:57.370981 run osmo-stp_10.42.42.5(pid=7927): Launched 04:21:57.494772 run osmo-msc_10.42.42.6: Starting osmo-msc 04:21:58.080129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7929): Launched 04:21:58.403209 run osmo-msc_10.42.42.6(pid=7930): Launched 04:21:58.583895 run osmo-stp_10.42.42.5(pid=7927): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7927)] 04:21:58.720026 run osmo-stp_10.42.42.5(pid=7927): stdout: | (launched: 2022-12-14_04:21:57.310974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:58.856777 run osmo-stp_10.42.42.5(pid=7927): stderr: | [0;m[38;5;43m20221214042157503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042157504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042157504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042157504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:58.992419 run osmo-stp_10.42.42.5(pid=7927): stdout: | (launched: 2022-12-14_04:21:57.310974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:21:59.120439 run osmo-stp_10.42.42.5(pid=7927): stderr: | [0;m[38;5;43m20221214042157503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042157504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042157504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042157504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042157505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:21:59.273771 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7927): Process ended prematurely: osmo-stp_10.42.42.5(pid=7927) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7927)] [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:21:59.283691 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:21:59.311923 run osmo-hlr_10.42.42.2(pid=7924): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7924)] 04:21:59.363259 run osmo-hlr_10.42.42.2(pid=7924): stdout: | (launched: 2022-12-14_04:21:56.301900) 04:21:59.415452 run osmo-hlr_10.42.42.2(pid=7924): stderr: | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042156500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042156513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042156523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042156523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042156524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:21:59.488858 run osmo-msc_10.42.42.6(pid=7930): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7930)] 04:21:59.539333 run osmo-msc_10.42.42.6(pid=7930): stdout: | (launched: 2022-12-14_04:21:58.343315) 04:21:59.591960 run osmo-msc_10.42.42.6(pid=7930): stderr: | [0;m[38;5;43m20221214042158666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042158666 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b014b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042158666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042158666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042158666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042158667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042158668 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042158669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042158669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042158669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:21:59.643815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7923): Terminating (SIGTERM) 04:21:59.685970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7926): Terminating (SIGTERM) 04:21:59.727893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7929): Terminating (SIGTERM) 04:21:59.770937 --- ParallelTerminationStrategy: PID 7923 died... 04:21:59.791759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7923): Terminated: ok {rc=0} 04:21:59.838737 --- ParallelTerminationStrategy: PID 7926 died... 04:21:59.858951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7926): Terminated: ok {rc=0} 04:21:59.905591 --- ParallelTerminationStrategy: PID 7929 died... 04:21:59.925723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7929): Terminated: ok {rc=0} 04:22:00.014991 bus /sierra_3: Setting Powered False 04:22:01.119634 bus /sierra_3: Setting Powered False 04:22:02.253685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:22:03.507922 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:03.516521 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:22:03.552316 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:22:03.579946 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:22:03.636654 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:22:03.669994 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:22:03.696898 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:22:04.247720 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:22:04.302253 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.313952 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:22:04.385753 tst mo_mt_call.py: using LAC 38514 04:22:04.515277 tst mo_mt_call.py: using RAC 9 04:22:04.643544 tst mo_mt_call.py: using CellId 38514 04:22:04.771718 tst mo_mt_call.py: using BVCI 38515 04:22:04.889617 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.901328 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.912720 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.924304 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.936285 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:04.948185 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:05.065169 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:05.187349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:05.691225 run create_hlr_db(pid=7935): Launched 04:22:05.814767 bus /sierra_2: Setting Powered False 04:22:06.878325 run create_hlr_db(pid=7935): Terminated: ok {rc=0} 04:22:07.330416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Launched 04:22:07.656373 run osmo-hlr_10.42.42.2(pid=7938): Launched 04:22:07.780403 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:08.339923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Launched 04:22:08.665409 run osmo-stp_10.42.42.5(pid=7941): Launched 04:22:08.790033 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:09.377011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7943): Launched 04:22:09.701233 run osmo-msc_10.42.42.6(pid=7944): Launched 04:22:09.881423 run osmo-stp_10.42.42.5(pid=7941): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] 04:22:10.018021 run osmo-stp_10.42.42.5(pid=7941): stdout: | (launched: 2022-12-14_04:22:08.605189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:10.155383 run osmo-stp_10.42.42.5(pid=7941): stderr: | [0;m[38;5;43m20221214042208797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042208797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042208798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042208798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042208799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042208799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:10.291538 run osmo-stp_10.42.42.5(pid=7941): stdout: | (launched: 2022-12-14_04:22:08.605189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:10.420078 run osmo-stp_10.42.42.5(pid=7941): stderr: | [0;m[38;5;43m20221214042208797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042208797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042208798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042208798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042208799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042208799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:10.574506 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7941): Process ended prematurely: osmo-stp_10.42.42.5(pid=7941) [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:22:10.584265 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:22:10.612429 run osmo-hlr_10.42.42.2(pid=7938): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7938)] 04:22:10.663348 run osmo-hlr_10.42.42.2(pid=7938): stdout: | (launched: 2022-12-14_04:22:07.596183) 04:22:10.715527 run osmo-hlr_10.42.42.2(pid=7938): stderr: | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042207795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042207807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042207816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042207816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042207816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:10.788747 run osmo-msc_10.42.42.6(pid=7944): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7944)] 04:22:10.838839 run osmo-msc_10.42.42.6(pid=7944): stdout: | (launched: 2022-12-14_04:22:09.640882) 04:22:10.890805 run osmo-msc_10.42.42.6(pid=7944): stderr: | [0;m[38;5;43m20221214042209964 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042209964 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f65dd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042209964 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042209965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042209965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042209966 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:10.943114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Terminating (SIGTERM) 04:22:10.985034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Terminating (SIGTERM) 04:22:11.027231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7943): Terminating (SIGTERM) 04:22:11.069522 --- ParallelTerminationStrategy: PID 7937 died... 04:22:11.090119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Terminated: ok {rc=0} 04:22:11.136703 --- ParallelTerminationStrategy: PID 7940 died... 04:22:11.156747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Terminated: ok {rc=0} 04:22:11.203043 --- ParallelTerminationStrategy: PID 7943 died... 04:22:11.223024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7943): Terminated: ok {rc=0} 04:22:11.310668 bus /sierra_3: Setting Powered False 04:22:12.410253 bus /sierra_3: Setting Powered False 04:22:13.526819 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:22:14.671832 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:14.683869 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:22:14.753707 tst mo_mt_call_osmux.py: using LAC 38515 04:22:14.876176 tst mo_mt_call_osmux.py: using RAC 10 04:22:14.994181 tst mo_mt_call_osmux.py: using CellId 38515 04:22:15.110779 tst mo_mt_call_osmux.py: using BVCI 38516 04:22:15.221328 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:15.232512 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:15.243555 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:15.254592 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:15.265780 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:22:15.276754 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:15.397295 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:22:15.515173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:16.010418 run create_hlr_db(pid=7946): Launched 04:22:16.160543 bus /sierra_2: Setting Powered False 04:22:17.228198 run create_hlr_db(pid=7946): Terminated: ok {rc=0} 04:22:17.657567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7948): Launched 04:22:17.960131 run osmo-hlr_10.42.42.2(pid=7949): Launched 04:22:18.073571 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:18.591275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7951): Launched 04:22:18.892869 run osmo-stp_10.42.42.5(pid=7952): Launched 04:22:19.006810 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:19.557841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7954): Launched 04:22:19.861663 run osmo-msc_10.42.42.6(pid=7955): Launched 04:22:20.030389 run osmo-stp_10.42.42.5(pid=7952): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7952)] 04:22:20.158048 run osmo-stp_10.42.42.5(pid=7952): stdout: | (launched: 2022-12-14_04:22:18.835950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:20.285697 run osmo-stp_10.42.42.5(pid=7952): stderr: | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042219008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:20.411062 run osmo-stp_10.42.42.5(pid=7952): stdout: | (launched: 2022-12-14_04:22:18.835950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:20.530824 run osmo-stp_10.42.42.5(pid=7952): stderr: | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042219007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042219008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042219008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:20.675230 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7952): Process ended prematurely: osmo-stp_10.42.42.5(pid=7952) [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7952)] [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:22:20.684186 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:22:20.710537 run osmo-hlr_10.42.42.2(pid=7949): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7949)] 04:22:20.758571 run osmo-hlr_10.42.42.2(pid=7949): stdout: | (launched: 2022-12-14_04:22:17.903440) 04:22:20.807699 run osmo-hlr_10.42.42.2(pid=7949): stderr: | [0;m[1;31m20221214042218080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042218080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042218080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042218081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042218081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042218081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042218092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042218101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042218102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042218102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:20.876280 run osmo-msc_10.42.42.6(pid=7955): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7955)] 04:22:20.923543 run osmo-msc_10.42.42.6(pid=7955): stdout: | (launched: 2022-12-14_04:22:19.804388) 04:22:20.972451 run osmo-msc_10.42.42.6(pid=7955): stderr: | [0;m[38;5;43m20221214042220077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042220077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f426a0b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042220077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042220077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042220077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042220078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042220079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042220080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042220080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042220080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:21.021731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7948): Terminating (SIGTERM) 04:22:21.060849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7951): Terminating (SIGTERM) 04:22:21.100209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7954): Terminating (SIGTERM) 04:22:21.139761 --- ParallelTerminationStrategy: PID 7948 died... 04:22:21.158793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7948): Terminated: ok {rc=0} 04:22:21.202391 --- ParallelTerminationStrategy: PID 7951 died... 04:22:21.220673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7951): Terminated: ok {rc=0} 04:22:21.264561 --- ParallelTerminationStrategy: PID 7954 died... 04:22:21.283030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7954): Terminated: ok {rc=0} 04:22:21.368234 bus /sierra_3: Setting Powered False 04:22:22.467245 bus /sierra_3: Setting Powered False 04:22:23.580255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:22:24.830731 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:24.836660 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:22:24.869527 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:22:24.895963 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:22:24.947265 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:22:24.980456 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:22:25.006889 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:22:25.555484 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:22:25.603294 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:25.614515 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:22:25.683601 tst mo_mt_call.py: using LAC 38516 04:22:25.801069 tst mo_mt_call.py: using RAC 11 04:22:25.919498 tst mo_mt_call.py: using CellId 38516 04:22:26.039540 tst mo_mt_call.py: using BVCI 38517 04:22:26.150142 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:26.160863 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:26.171519 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:26.182092 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:26.192638 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:26.203309 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:26.322313 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:26.443193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:26.944342 run create_hlr_db(pid=7960): Launched 04:22:27.067960 bus /sierra_2: Setting Powered False 04:22:28.132267 run create_hlr_db(pid=7960): Terminated: ok {rc=0} 04:22:28.565441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Launched 04:22:28.869107 run osmo-hlr_10.42.42.2(pid=7963): Launched 04:22:28.982873 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:29.515534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Launched 04:22:29.816579 run osmo-stp_10.42.42.5(pid=7966): Launched 04:22:29.930867 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:30.476636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7968): Launched 04:22:30.778918 run osmo-msc_10.42.42.6(pid=7969): Launched 04:22:31.018492 run osmo-stp_10.42.42.5(pid=7966): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] 04:22:31.281707 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-14_04:22:29.759842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:31.696069 run osmo-stp_10.42.42.5(pid=7966): stderr: | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042229932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:31.868630 run osmo-stp_10.42.42.5(pid=7966): stdout: | (launched: 2022-12-14_04:22:29.759842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:31.994772 run osmo-stp_10.42.42.5(pid=7966): stderr: | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042229931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042229932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:32.144517 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:22:32.154117 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 04:22:32.181147 run osmo-hlr_10.42.42.2(pid=7963): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7963)] 04:22:32.230680 run osmo-hlr_10.42.42.2(pid=7963): stdout: | (launched: 2022-12-14_04:22:28.812176) 04:22:32.281889 run osmo-hlr_10.42.42.2(pid=7963): stderr: | [0;m[1;31m20221214042228991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042228991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042228991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042228991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042228991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042228992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042229003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042229012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042229013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042229013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:32.353126 run osmo-msc_10.42.42.6(pid=7969): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7969)] 04:22:32.401856 run osmo-msc_10.42.42.6(pid=7969): stdout: | (launched: 2022-12-14_04:22:30.722305) 04:22:32.451255 run osmo-msc_10.42.42.6(pid=7969): stderr: | [0;m[38;5;43m20221214042231260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042231260 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ebe9ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042231263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042231266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042231267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042231268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042231273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042231274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042231274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042231274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:32.500793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminating (SIGTERM) 04:22:32.539878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminating (SIGTERM) 04:22:32.579049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7968): Terminating (SIGTERM) 04:22:32.618209 --- ParallelTerminationStrategy: PID 7962 died... 04:22:32.636908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7962): Terminated: ok {rc=0} 04:22:32.680582 --- ParallelTerminationStrategy: PID 7965 died... 04:22:32.699400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7965): Terminated: ok {rc=0} 04:22:32.742748 --- ParallelTerminationStrategy: PID 7968 died... 04:22:32.761148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7968): Terminated: ok {rc=0} 04:22:32.845871 bus /sierra_3: Setting Powered False 04:22:33.945271 bus /sierra_3: Setting Powered False 04:22:35.058157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:22:36.205862 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.217923 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:22:36.291115 tst mo_mt_call_osmux.py: using LAC 38517 04:22:36.419116 tst mo_mt_call_osmux.py: using RAC 12 04:22:36.548793 tst mo_mt_call_osmux.py: using CellId 38517 04:22:36.679705 tst mo_mt_call_osmux.py: using BVCI 38518 04:22:36.798030 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.809405 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.820480 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.831561 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.843002 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:22:36.854539 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:36.975124 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:22:37.091886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:37.560159 run create_hlr_db(pid=7971): Launched 04:22:37.683776 bus /sierra_2: Setting Powered False 04:22:38.745187 run create_hlr_db(pid=7971): Terminated: ok {rc=0} 04:22:39.186221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7973): Launched 04:22:39.509404 run osmo-hlr_10.42.42.2(pid=7974): Launched 04:22:39.634015 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:40.190252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7976): Launched 04:22:40.513800 run osmo-stp_10.42.42.5(pid=7977): Launched 04:22:40.637980 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:41.222078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7979): Launched 04:22:41.545039 run osmo-msc_10.42.42.6(pid=7980): Launched 04:22:41.725811 run osmo-stp_10.42.42.5(pid=7977): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7977)] 04:22:41.862020 run osmo-stp_10.42.42.5(pid=7977): stdout: | (launched: 2022-12-14_04:22:40.453480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:41.999073 run osmo-stp_10.42.42.5(pid=7977): stderr: | [0;m[38;5;43m20221214042240647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042240647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042240648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042240648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:42.135392 run osmo-stp_10.42.42.5(pid=7977): stdout: | (launched: 2022-12-14_04:22:40.453480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:42.263552 run osmo-stp_10.42.42.5(pid=7977): stderr: | [0;m[38;5;43m20221214042240647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042240647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042240648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042240648 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042240649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:42.417483 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7977): Process ended prematurely: osmo-stp_10.42.42.5(pid=7977) [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7977)] [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:22:42.427179 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:22:42.455258 run osmo-hlr_10.42.42.2(pid=7974): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7974)] 04:22:42.507012 run osmo-hlr_10.42.42.2(pid=7974): stdout: | (launched: 2022-12-14_04:22:39.449335) 04:22:42.559411 run osmo-hlr_10.42.42.2(pid=7974): stderr: | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042239648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042239676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042239686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042239686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042239686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:42.632532 run osmo-msc_10.42.42.6(pid=7980): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7980)] 04:22:42.682772 run osmo-msc_10.42.42.6(pid=7980): stdout: | (launched: 2022-12-14_04:22:41.484411) 04:22:42.735210 run osmo-msc_10.42.42.6(pid=7980): stderr: | [0;m[38;5;43m20221214042241811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042241811 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c25f36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042241811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042241811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042241811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042241812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042241813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042241814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042241814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042241814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:42.788267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7973): Terminating (SIGTERM) 04:22:42.830657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7976): Terminating (SIGTERM) 04:22:42.872877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7979): Terminating (SIGTERM) 04:22:42.916086 --- ParallelTerminationStrategy: PID 7973 died... 04:22:42.936791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7973): Terminated: ok {rc=0} 04:22:42.983863 --- ParallelTerminationStrategy: PID 7976 died... 04:22:43.004024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7976): Terminated: ok {rc=0} 04:22:43.050824 --- ParallelTerminationStrategy: PID 7979 died... 04:22:43.071028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7979): Terminated: ok {rc=0} 04:22:43.160263 bus /sierra_3: Setting Powered False 04:22:44.259656 bus /sierra_3: Setting Powered False 04:22:45.374554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:trx-lms --------------------------------------------------------------------- 04:22:46.626032 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:22:46.632311 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 04:22:46.672439 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 04:22:46.706470 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 04:22:46.803195 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 04:22:46.850910 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 04:22:46.879821 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 04:22:47.449947 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 04:22:47.455813 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:47.467989 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:22:47.516154 tst emergency_mo_mt_call.py: using LAC 38518 04:22:47.634107 tst emergency_mo_mt_call.py: using RAC 13 04:22:47.750287 tst emergency_mo_mt_call.py: using CellId 38518 04:22:47.864905 tst emergency_mo_mt_call.py: using BVCI 38519 04:22:47.971675 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:47.982343 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:47.992711 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:48.003075 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:48.013478 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:48.023756 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:48.137810 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:48.259576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:48.754274 run create_hlr_db(pid=7986): Launched 04:22:48.877084 bus /sierra_2: Setting Powered False 04:22:49.940462 run create_hlr_db(pid=7986): Terminated: ok {rc=0} 04:22:50.385145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Launched 04:22:50.702784 run osmo-hlr_10.42.42.2(pid=7989): Launched 04:22:50.823412 run osmo-stp_10.42.42.5: Starting osmo-stp 04:22:51.366873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7991): Launched 04:22:51.684398 run osmo-stp_10.42.42.5(pid=7992): Launched 04:22:51.815950 tst emergency_mo_mt_call.py: using MSISDN 8500 04:22:52.032141 run osmo-msc_10.42.42.6: Starting osmo-msc 04:22:52.604740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7994): Launched 04:22:52.922712 run osmo-msc_10.42.42.6(pid=7995): Launched 04:22:53.099004 run osmo-stp_10.42.42.5(pid=7992): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7992)] 04:22:53.233170 run osmo-stp_10.42.42.5(pid=7992): stdout: | (launched: 2022-12-14_04:22:51.625353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:53.368056 run osmo-stp_10.42.42.5(pid=7992): stderr: | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042251819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:53.502673 run osmo-stp_10.42.42.5(pid=7992): stdout: | (launched: 2022-12-14_04:22:51.625353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:22:53.629457 run osmo-stp_10.42.42.5(pid=7992): stderr: | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042251818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042251819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042251819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:22:53.781014 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7992): Process ended prematurely: osmo-stp_10.42.42.5(pid=7992) [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7992)] [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 04:22:53.789947 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 04:22:53.817554 run osmo-hlr_10.42.42.2(pid=7989): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7989)] 04:22:53.868466 run osmo-hlr_10.42.42.2(pid=7989): stdout: | (launched: 2022-12-14_04:22:50.643799) 04:22:53.920521 run osmo-hlr_10.42.42.2(pid=7989): stderr: | [0;m[1;31m20221214042250841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042250841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042250842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042250842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042250842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042250842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042250876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042250886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042250886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042250886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:22:53.993300 run osmo-msc_10.42.42.6(pid=7995): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7995)] 04:22:54.043244 run osmo-msc_10.42.42.6(pid=7995): stdout: | (launched: 2022-12-14_04:22:52.863609) 04:22:54.095385 run osmo-msc_10.42.42.6(pid=7995): stderr: | [0;m[38;5;43m20221214042253184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042253184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0e46c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042253184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042253184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042253185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042253185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042253187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042253187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042253187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042253187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:22:54.148106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Terminating (SIGTERM) 04:22:54.189898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7991): Terminating (SIGTERM) 04:22:54.231648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7994): Terminating (SIGTERM) 04:22:54.273966 --- ParallelTerminationStrategy: PID 7988 died... 04:22:54.294549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Terminated: ok {rc=0} 04:22:54.341362 --- ParallelTerminationStrategy: PID 7991 died... 04:22:54.361684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7991): Terminated: ok {rc=0} 04:22:54.408207 --- ParallelTerminationStrategy: PID 7994 died... 04:22:54.428217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7994): Terminated: ok {rc=0} 04:22:54.518209 bus /sierra_3: Setting Powered False 04:22:55.617462 bus /sierra_3: Setting Powered False 04:22:56.734448 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 04:22:57.821208 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:57.832161 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 04:22:57.882200 tst emergency_preemptive_call.py: using LAC 38519 04:22:58.010283 tst emergency_preemptive_call.py: using RAC 14 04:22:58.129120 tst emergency_preemptive_call.py: using CellId 38519 04:22:58.246382 tst emergency_preemptive_call.py: using BVCI 38520 04:22:58.351874 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:58.362513 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:58.372866 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:58.383264 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:58.393757 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 04:22:58.404523 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:58.518127 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:58.635427 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:58.749599 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 04:22:58.864533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:22:59.345985 run create_hlr_db(pid=7997): Launched 04:22:59.463841 bus /sierra_2: Setting Powered False 04:23:00.526690 run create_hlr_db(pid=7997): Terminated: ok {rc=0} 04:23:00.992250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7999): Launched 04:23:01.311895 run osmo-hlr_10.42.42.2(pid=8000): Launched 04:23:01.666219 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:02.259875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8002): Launched 04:23:02.573539 run osmo-stp_10.42.42.5(pid=8003): Launched 04:23:02.701064 tst emergency_preemptive_call.py: using MSISDN 8501 04:23:02.859727 run osmo-msc_10.42.42.6: Starting osmo-msc 04:23:03.417247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8005): Launched 04:23:03.728534 run osmo-msc_10.42.42.6(pid=8006): Launched 04:23:03.899780 run osmo-stp_10.42.42.5(pid=8003): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8003)] 04:23:04.032437 run osmo-stp_10.42.42.5(pid=8003): stdout: | (launched: 2022-12-14_04:23:02.516055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:04.165834 run osmo-stp_10.42.42.5(pid=8003): stderr: | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042302708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:04.297247 run osmo-stp_10.42.42.5(pid=8003): stdout: | (launched: 2022-12-14_04:23:02.516055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:04.421175 run osmo-stp_10.42.42.5(pid=8003): stderr: | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042302707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042302708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042302708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:04.569978 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8003): Process ended prematurely: osmo-stp_10.42.42.5(pid=8003) [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8003)] [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py:32] 04:23:04.578844 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 04:23:04.606216 run osmo-hlr_10.42.42.2(pid=8000): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8000)] 04:23:04.657224 run osmo-hlr_10.42.42.2(pid=8000): stdout: | (launched: 2022-12-14_04:23:01.242356) 04:23:04.709990 run osmo-hlr_10.42.42.2(pid=8000): stderr: | [0;m[1;31m20221214042301461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042301461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042301461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042301461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042301461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042301462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042301475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042301486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042301487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042301487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:04.783475 run osmo-msc_10.42.42.6(pid=8006): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8006)] 04:23:04.833757 run osmo-msc_10.42.42.6(pid=8006): stdout: | (launched: 2022-12-14_04:23:03.670957) 04:23:04.885858 run osmo-msc_10.42.42.6(pid=8006): stderr: | [0;m[38;5;43m20221214042303987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042303987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f360065ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042303987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042303987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042303987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042303987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042303989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042303990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042303990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042303990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:23:04.938401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7999): Terminating (SIGTERM) 04:23:04.980807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8002): Terminating (SIGTERM) 04:23:05.023140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8005): Terminating (SIGTERM) 04:23:05.065767 --- ParallelTerminationStrategy: PID 7999 died... 04:23:05.086200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7999): Terminated: ok {rc=0} 04:23:05.133088 --- ParallelTerminationStrategy: PID 8002 died... 04:23:05.153092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8002): Terminated: ok {rc=0} 04:23:05.199640 --- ParallelTerminationStrategy: PID 8005 died... 04:23:05.219547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8005): Terminated: ok {rc=0} 04:23:05.308133 bus /sierra_9: Setting Powered False 04:23:06.406607 bus /sierra_9: Setting Powered False 04:23:07.523058 bus /sierra_8: Setting Powered False 04:23:08.621923 bus /sierra_8: Setting Powered False 04:23:09.741770 bus /sierra_3: Setting Powered False 04:23:10.840686 bus /sierra_3: Setting Powered False 04:23:11.957603 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms --------------------------------------------------------------------- 04:23:13.238928 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:23:13.244287 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 04:23:13.278565 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 04:23:13.318197 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 04:23:13.405845 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 04:23:13.438285 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 04:23:13.475857 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 04:23:14.064552 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 04:23:14.112473 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.122996 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:14.169266 tst cs_paging_gprs_active.py: using LAC 38520 04:23:14.285439 tst cs_paging_gprs_active.py: using RAC 15 04:23:14.402021 tst cs_paging_gprs_active.py: using CellId 38520 04:23:14.517734 tst cs_paging_gprs_active.py: using BVCI 38521 04:23:14.623786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.634343 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.645114 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.655378 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.665524 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.675828 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.686370 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.696600 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:14.707121 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:14.825867 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:14.945782 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:23:15.160549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:15.478942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8011): Launched 04:23:15.756724 run iperf3-srv_10.42.42.10(pid=8012): Launched 04:23:15.876320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:23:16.102171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:16.437974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8013): Launched 04:23:16.726349 run iperf3-srv_10.42.42.10(pid=8014): Launched 04:23:16.855318 tst cs_paging_gprs_active.py:38: start network... 04:23:17.069346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:17.540679 run create_hlr_db(pid=8015): Launched 04:23:17.666787 bus /sierra_2: Setting Powered False 04:23:18.726859 run create_hlr_db(pid=8015): Terminated: ok {rc=0} 04:23:19.166768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8017): Launched 04:23:19.489047 run osmo-hlr_10.42.42.2(pid=8018): Launched 04:23:19.613069 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:20.169885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8020): Launched 04:23:20.491654 run osmo-stp_10.42.42.5(pid=8021): Launched 04:23:20.615305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:21.170061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8023): Launched 04:23:21.294549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:21.566265 run patchelf(pid=8024): Launched 04:23:21.745086 run osmo-stp_10.42.42.5(pid=8021): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8021)] 04:23:21.880833 run osmo-stp_10.42.42.5(pid=8021): stdout: | (launched: 2022-12-14_04:23:20.432200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:22.018357 run osmo-stp_10.42.42.5(pid=8021): stderr: | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042320623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:22.155929 run osmo-stp_10.42.42.5(pid=8021): stdout: | (launched: 2022-12-14_04:23:20.432200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:22.287696 run osmo-stp_10.42.42.5(pid=8021): stderr: | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042320622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042320623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042320623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:22.444004 run patchelf(pid=8024): Terminating (SIGINT) 04:23:22.623446 run patchelf(pid=8024): Terminated: ok {rc=0} 04:23:22.753168 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8021): Process ended prematurely: osmo-stp_10.42.42.5(pid=8021) [trial-2399↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8021)] [trial-2399↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 04:23:22.763426 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:23:22.791988 run osmo-hlr_10.42.42.2(pid=8018): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8018)] 04:23:22.842517 run osmo-hlr_10.42.42.2(pid=8018): stdout: | (launched: 2022-12-14_04:23:19.429858) 04:23:22.894288 run osmo-hlr_10.42.42.2(pid=8018): stderr: | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042319626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042319639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042319647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042319647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042319647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:22.946556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8011): Terminating (SIGTERM) 04:23:22.988599 run iperf3-srv_10.42.42.10(pid=8012): Terminating (SIGTERM) 04:23:23.030390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8013): Terminating (SIGTERM) 04:23:23.072539 run iperf3-srv_10.42.42.10(pid=8014): Terminating (SIGTERM) 04:23:23.114792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8017): Terminating (SIGTERM) 04:23:23.157140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8020): Terminating (SIGTERM) 04:23:23.199054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8023): Terminating (SIGTERM) 04:23:23.241857 --- ParallelTerminationStrategy: PID 8011 died... 04:23:23.262577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8011): Terminated: ok {rc=0} 04:23:23.309087 --- ParallelTerminationStrategy: PID 8012 died... 04:23:23.329007 run iperf3-srv_10.42.42.10(pid=8012): Terminated {rc=256} 04:23:23.374995 --- ParallelTerminationStrategy: PID 8013 died... 04:23:23.394951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8013): Terminated: ok {rc=0} 04:23:23.441116 --- ParallelTerminationStrategy: PID 8014 died... 04:23:23.460904 run iperf3-srv_10.42.42.10(pid=8014): Terminated {rc=256} 04:23:23.506915 --- ParallelTerminationStrategy: PID 8017 died... 04:23:23.526989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8017): Terminated: ok {rc=0} 04:23:23.573086 --- ParallelTerminationStrategy: PID 8020 died... 04:23:23.592789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8020): Terminated: ok {rc=0} 04:23:23.639182 --- ParallelTerminationStrategy: PID 8023 died... 04:23:23.659159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8023): Terminated: ok {rc=0} 04:23:23.747947 bus /gobi_0: Setting Powered False 04:23:24.848704 bus /gobi_0: Setting Powered False 04:23:25.966334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms iperf3.py ---------------------------------------------- 04:23:27.116921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.128675 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:27.181156 tst iperf3.py: using LAC 38521 04:23:27.306471 tst iperf3.py: using RAC 16 04:23:27.434349 tst iperf3.py: using CellId 38521 04:23:27.562339 tst iperf3.py: using BVCI 38522 04:23:27.679846 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.691142 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.702160 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.713127 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.724415 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.735734 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.747261 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.758600 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:27.770084 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:27.885331 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:28.084706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:28.385189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Launched 04:23:28.646233 run iperf3-srv_10.42.42.10(pid=8026): Launched 04:23:28.758403 tst iperf3.py:8: start network... 04:23:28.956884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:29.419808 run create_hlr_db(pid=8027): Launched 04:23:29.542494 bus /gobi_6: Setting Powered False 04:23:30.603346 run create_hlr_db(pid=8027): Terminated: ok {rc=0} 04:23:31.089689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8029): Launched 04:23:31.428405 run osmo-hlr_10.42.42.2(pid=8030): Launched 04:23:31.670429 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:32.294318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8032): Launched 04:23:32.629468 run osmo-stp_10.42.42.5(pid=8033): Launched 04:23:32.753163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:33.309522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8035): Launched 04:23:33.432460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:33.705787 run patchelf(pid=8036): Launched 04:23:33.885204 run osmo-stp_10.42.42.5(pid=8033): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8033)] 04:23:34.022032 run osmo-stp_10.42.42.5(pid=8033): stdout: | (launched: 2022-12-14_04:23:32.570162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:34.160068 run osmo-stp_10.42.42.5(pid=8033): stderr: | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042332763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:34.298752 run osmo-stp_10.42.42.5(pid=8033): stdout: | (launched: 2022-12-14_04:23:32.570162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:34.430919 run osmo-stp_10.42.42.5(pid=8033): stderr: | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042332762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042332763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042332763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:34.588177 run patchelf(pid=8036): Terminating (SIGINT) 04:23:34.768432 run patchelf(pid=8036): Terminated: ok {rc=0} 04:23:34.898379 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8033): Process ended prematurely: osmo-stp_10.42.42.5(pid=8033) [trial-2399↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8033)] [trial-2399↪gprs:trx-lms↪iperf3.py:8] 04:23:34.908525 tst iperf3.py:8: Test FAILED (7.8 sec) 04:23:34.937281 run osmo-hlr_10.42.42.2(pid=8030): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8030)] 04:23:34.988231 run osmo-hlr_10.42.42.2(pid=8030): stdout: | (launched: 2022-12-14_04:23:31.367010) 04:23:35.041367 run osmo-hlr_10.42.42.2(pid=8030): stderr: | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042331597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042331625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042331642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042331642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042331642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:35.093811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Terminating (SIGTERM) 04:23:35.135694 run iperf3-srv_10.42.42.10(pid=8026): Terminating (SIGTERM) 04:23:35.178500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8029): Terminating (SIGTERM) 04:23:35.220435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8032): Terminating (SIGTERM) 04:23:35.259552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8035): Terminating (SIGTERM) 04:23:35.298855 --- ParallelTerminationStrategy: PID 8025 died... 04:23:35.317807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8025): Terminated: ok {rc=0} 04:23:35.361338 --- ParallelTerminationStrategy: PID 8026 died... 04:23:35.380193 run iperf3-srv_10.42.42.10(pid=8026): Terminated {rc=256} 04:23:35.423560 --- ParallelTerminationStrategy: PID 8029 died... 04:23:35.441954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8029): Terminated: ok {rc=0} 04:23:35.485152 --- ParallelTerminationStrategy: PID 8032 died... 04:23:35.503487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8032): Terminated: ok {rc=0} 04:23:35.546989 --- ParallelTerminationStrategy: PID 8035 died... 04:23:35.565486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8035): Terminated: ok {rc=0} 04:23:35.650730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms iperf3m4.py ---------------------------------------------- 04:23:36.796852 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:36.807897 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:36.856720 tst iperf3m4.py: using LAC 38522 04:23:36.974810 tst iperf3m4.py: using RAC 17 04:23:37.093723 tst iperf3m4.py: using CellId 38522 04:23:37.210472 tst iperf3m4.py: using BVCI 38523 04:23:37.319938 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.330595 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.340910 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.351272 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.361451 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.371593 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.382020 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.392187 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:37.402558 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:37.518265 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:37.643012 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:37.759592 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:37.878068 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:23:38.093892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:38.414858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8037): Launched 04:23:38.693905 run iperf3-srv_10.42.42.10(pid=8038): Launched 04:23:38.814059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:23:39.028288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:39.349497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8039): Launched 04:23:39.628545 run iperf3-srv_10.42.42.10(pid=8040): Launched 04:23:39.748398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:23:39.962522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:40.282872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Launched 04:23:40.560852 run iperf3-srv_10.42.42.10(pid=8042): Launched 04:23:40.680911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:23:40.895002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:23:41.215809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Launched 04:23:41.493676 run iperf3-srv_10.42.42.10(pid=8044): Launched 04:23:41.614579 tst iperf3m4.py:8: start network... 04:23:41.829484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:42.329393 run create_hlr_db(pid=8045): Launched 04:23:42.452022 bus /gobi_6: Setting Powered False 04:23:43.516059 run create_hlr_db(pid=8045): Terminated: ok {rc=0} 04:23:43.961878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8047): Launched 04:23:44.281493 run osmo-hlr_10.42.42.2(pid=8048): Launched 04:23:44.403781 run osmo-stp_10.42.42.5: Starting osmo-stp 04:23:44.928725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8050): Launched 04:23:45.249691 run osmo-stp_10.42.42.5(pid=8051): Launched 04:23:45.370717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:23:45.924189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8053): Launched 04:23:46.048134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:23:46.325357 run patchelf(pid=8054): Launched 04:23:46.519133 run osmo-stp_10.42.42.5(pid=8051): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8051)] 04:23:46.658453 run osmo-stp_10.42.42.5(pid=8051): stdout: | (launched: 2022-12-14_04:23:45.190558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:46.799736 run osmo-stp_10.42.42.5(pid=8051): stderr: | [0;m[38;5;43m20221214042345379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042345380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042345380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042345380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:46.939986 run osmo-stp_10.42.42.5(pid=8051): stdout: | (launched: 2022-12-14_04:23:45.190558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:23:47.074665 run osmo-stp_10.42.42.5(pid=8051): stderr: | [0;m[38;5;43m20221214042345379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042345380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042345380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042345380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042345381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:23:47.233964 run patchelf(pid=8054): Terminating (SIGINT) 04:23:47.414070 run patchelf(pid=8054): Terminated: ok {rc=0} 04:23:47.544688 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8051): Process ended prematurely: osmo-stp_10.42.42.5(pid=8051) [trial-2399↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8051)] [trial-2399↪gprs:trx-lms↪iperf3m4.py:8] 04:23:47.555088 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:23:47.583976 run osmo-hlr_10.42.42.2(pid=8048): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8048)] 04:23:47.634597 run osmo-hlr_10.42.42.2(pid=8048): stdout: | (launched: 2022-12-14_04:23:44.222435) 04:23:47.686777 run osmo-hlr_10.42.42.2(pid=8048): stderr: | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042344416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042344430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042344438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042344439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042344439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:23:47.739804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8037): Terminating (SIGTERM) 04:23:47.781457 run iperf3-srv_10.42.42.10(pid=8038): Terminating (SIGTERM) 04:23:47.823256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8039): Terminating (SIGTERM) 04:23:47.865048 run iperf3-srv_10.42.42.10(pid=8040): Terminating (SIGTERM) 04:23:47.907235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Terminating (SIGTERM) 04:23:47.949149 run iperf3-srv_10.42.42.10(pid=8042): Terminating (SIGTERM) 04:23:47.991600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminating (SIGTERM) 04:23:48.034313 run iperf3-srv_10.42.42.10(pid=8044): Terminating (SIGTERM) 04:23:48.076512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8047): Terminating (SIGTERM) 04:23:48.118521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8050): Terminating (SIGTERM) 04:23:48.160941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8053): Terminating (SIGTERM) 04:23:48.203108 --- ParallelTerminationStrategy: PID 8037 died... 04:23:48.223463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8037): Terminated: ok {rc=0} 04:23:48.270067 --- ParallelTerminationStrategy: PID 8038 died... 04:23:48.290239 run iperf3-srv_10.42.42.10(pid=8038): Terminated {rc=256} 04:23:48.336279 --- ParallelTerminationStrategy: PID 8039 died... 04:23:48.356144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8039): Terminated: ok {rc=0} 04:23:48.402354 --- ParallelTerminationStrategy: PID 8040 died... 04:23:48.422169 run iperf3-srv_10.42.42.10(pid=8040): Terminated {rc=256} 04:23:48.468528 --- ParallelTerminationStrategy: PID 8041 died... 04:23:48.488385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Terminated: ok {rc=0} 04:23:48.534968 --- ParallelTerminationStrategy: PID 8042 died... 04:23:48.554739 run iperf3-srv_10.42.42.10(pid=8042): Terminated {rc=256} 04:23:48.600819 --- ParallelTerminationStrategy: PID 8043 died... 04:23:48.621112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminated: ok {rc=0} 04:23:48.667153 --- ParallelTerminationStrategy: PID 8044 died... 04:23:48.686944 run iperf3-srv_10.42.42.10(pid=8044): Terminated {rc=256} 04:23:48.733162 --- ParallelTerminationStrategy: PID 8047 died... 04:23:48.752938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8047): Terminated: ok {rc=0} 04:23:48.799247 --- ParallelTerminationStrategy: PID 8050 died... 04:23:48.819227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8050): Terminated: ok {rc=0} 04:23:48.865463 --- ParallelTerminationStrategy: PID 8053 died... 04:23:48.885458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8053): Terminated: ok {rc=0} 04:23:48.974430 bus /gobi_4: Setting Powered False 04:23:50.072444 bus /gobi_4: Setting Powered False 04:23:51.191367 bus /gobi_1: Setting Powered False 04:23:52.289765 bus /gobi_1: Setting Powered False 04:23:53.405587 bus /gobi_0: Setting Powered False 04:23:54.500690 bus /gobi_0: Setting Powered False 04:23:55.615529 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms ping.py ---------------------------------------------- 04:23:56.720803 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:56.732769 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:23:56.783990 tst ping.py: using LAC 38523 04:23:56.902522 tst ping.py: using RAC 18 04:23:57.020212 tst ping.py: using CellId 38523 04:23:57.135637 tst ping.py: using BVCI 38524 04:23:57.252189 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.263525 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.274696 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.285546 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.296744 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.308091 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.319409 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:23:57.330747 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:23:57.449133 tst ping.py:19: start network... 04:23:57.662132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:23:58.151390 run create_hlr_db(pid=8056): Launched 04:23:58.270930 bus /gobi_6: Setting Powered False 04:23:59.334316 run create_hlr_db(pid=8056): Terminated: ok {rc=0} 04:23:59.758466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8058): Launched 04:24:00.052509 run osmo-hlr_10.42.42.2(pid=8059): Launched 04:24:00.163175 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:00.673888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8061): Launched 04:24:00.996742 run osmo-stp_10.42.42.5(pid=8062): Launched 04:24:01.240685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:01.956664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8100): Launched 04:24:02.091405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:02.390982 run patchelf(pid=8113): Launched 04:24:02.620530 run osmo-stp_10.42.42.5(pid=8062): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8062)] 04:24:02.781134 run osmo-stp_10.42.42.5(pid=8062): stdout: | (launched: 2022-12-14_04:24:00.937015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:02.938699 run osmo-stp_10.42.42.5(pid=8062): stderr: | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042401222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:03.106155 run osmo-stp_10.42.42.5(pid=8062): stdout: | (launched: 2022-12-14_04:24:00.937015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:03.262461 run osmo-stp_10.42.42.5(pid=8062): stderr: | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042401222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042401222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042401223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:03.427242 run patchelf(pid=8113): Terminating (SIGINT) 04:24:03.622180 run patchelf(pid=8113): Terminated: ok {rc=0} 04:24:03.775499 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8062): Process ended prematurely: osmo-stp_10.42.42.5(pid=8062) [trial-2399↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8062)] [trial-2399↪gprs:trx-lms↪ping.py:22] 04:24:03.789401 tst ping.py:22: Test FAILED (7.1 sec) 04:24:03.823884 run osmo-hlr_10.42.42.2(pid=8059): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8059)] 04:24:03.884801 run osmo-hlr_10.42.42.2(pid=8059): stdout: | (launched: 2022-12-14_04:23:59.998121) 04:24:03.949484 run osmo-hlr_10.42.42.2(pid=8059): stderr: | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042400171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042400183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042400192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042400192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042400192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:04.020058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8058): Terminating (SIGTERM) 04:24:04.068632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8061): Terminating (SIGTERM) 04:24:04.119995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8100): Terminating (SIGTERM) 04:24:04.170640 --- ParallelTerminationStrategy: PID 8058 died... 04:24:04.195599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8058): Terminated: ok {rc=0} 04:24:04.259442 --- ParallelTerminationStrategy: PID 8061 died... 04:24:04.281190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8061): Terminated: ok {rc=0} 04:24:04.332569 --- ParallelTerminationStrategy: PID 8100 died... 04:24:04.358332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8100): Terminated: ok {rc=0} 04:24:04.462657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 04:24:05.556997 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:05.569384 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 04:24:05.618676 tst ping_idle_ping.py: using LAC 38524 04:24:05.740094 tst ping_idle_ping.py: using RAC 19 04:24:05.858363 tst ping_idle_ping.py: using CellId 38524 04:24:05.979484 tst ping_idle_ping.py: using BVCI 38525 04:24:06.089284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.100864 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.112362 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.123867 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.136454 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.148255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.160086 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 04:24:06.171953 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 04:24:06.289998 tst ping_idle_ping.py:24: start network... 04:24:06.492191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:06.962632 run create_hlr_db(pid=8337): Launched 04:24:07.118697 bus /gobi_6: Setting Powered False 04:24:08.183289 run create_hlr_db(pid=8337): Terminated: ok {rc=0} 04:24:08.637467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8339): Launched 04:24:08.974313 run osmo-hlr_10.42.42.2(pid=8340): Launched 04:24:09.206519 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:09.891729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8342): Launched 04:24:10.209391 run osmo-stp_10.42.42.5(pid=8343): Launched 04:24:10.440768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:11.105691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8345): Launched 04:24:11.232912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:11.489234 run patchelf(pid=8346): Launched 04:24:11.672253 run osmo-stp_10.42.42.5(pid=8343): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8343)] 04:24:11.800423 run osmo-stp_10.42.42.5(pid=8343): stdout: | (launched: 2022-12-14_04:24:10.149211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:11.930725 run osmo-stp_10.42.42.5(pid=8343): stderr: | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042410470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:12.061433 run osmo-stp_10.42.42.5(pid=8343): stdout: | (launched: 2022-12-14_04:24:10.149211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:12.185433 run osmo-stp_10.42.42.5(pid=8343): stderr: | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042410469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042410470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042410470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:12.332080 run patchelf(pid=8346): Terminating (SIGINT) 04:24:12.501927 run patchelf(pid=8346): Terminated: ok {rc=0} 04:24:12.624149 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8343): Process ended prematurely: osmo-stp_10.42.42.5(pid=8343) [trial-2399↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8343)] [trial-2399↪gprs:trx-lms↪ping_idle_ping.py:27] 04:24:12.634277 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 04:24:12.662479 run osmo-hlr_10.42.42.2(pid=8340): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8340)] 04:24:12.712107 run osmo-hlr_10.42.42.2(pid=8340): stdout: | (launched: 2022-12-14_04:24:08.914625) 04:24:12.763096 run osmo-hlr_10.42.42.2(pid=8340): stderr: | [0;m[1;31m20221214042409245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042409245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042409245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042409245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042409246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042409246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042409265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042409278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042409278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042409278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:12.814698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8339): Terminating (SIGTERM) 04:24:12.855981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8342): Terminating (SIGTERM) 04:24:12.898087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8345): Terminating (SIGTERM) 04:24:12.940723 --- ParallelTerminationStrategy: PID 8339 died... 04:24:12.962547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8339): Terminated: ok {rc=0} 04:24:13.009807 --- ParallelTerminationStrategy: PID 8342 died... 04:24:13.029768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8342): Terminated: ok {rc=0} 04:24:13.075190 --- ParallelTerminationStrategy: PID 8345 died... 04:24:13.095210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8345): Terminated: ok {rc=0} 04:24:13.181370 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 04:24:14.483728 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:24:14.489926 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:24:14.524108 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:24:14.568041 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:24:14.656596 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:24:14.691055 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:24:14.733827 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:24:15.324654 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:24:15.377956 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.389813 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:15.441382 tst cs_paging_gprs_active.py: using LAC 38525 04:24:15.568245 tst cs_paging_gprs_active.py: using RAC 20 04:24:15.690388 tst cs_paging_gprs_active.py: using CellId 38525 04:24:15.813892 tst cs_paging_gprs_active.py: using BVCI 38526 04:24:15.931773 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.950267 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.962139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.974204 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.986042 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:15.997978 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:16.014899 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:16.026736 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:16.040013 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:16.159939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:16.278437 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:24:16.519242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:16.900342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8352): Launched 04:24:17.242980 run iperf3-srv_10.42.42.10(pid=8353): Launched 04:24:17.396291 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:24:17.655301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:18.031828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Launched 04:24:18.367294 run iperf3-srv_10.42.42.10(pid=8355): Launched 04:24:18.498541 tst cs_paging_gprs_active.py:38: start network... 04:24:18.710587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:19.199934 run create_hlr_db(pid=8356): Launched 04:24:19.364904 bus /gobi_6: Setting Powered False 04:24:20.426713 run create_hlr_db(pid=8356): Terminated: ok {rc=0} 04:24:20.864664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Launched 04:24:21.189745 run osmo-hlr_10.42.42.2(pid=8359): Launched 04:24:21.426414 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:22.140789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Launched 04:24:22.465730 run osmo-stp_10.42.42.5(pid=8362): Launched 04:24:22.716388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:23.396248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8364): Launched 04:24:23.528603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:23.795390 run patchelf(pid=8365): Launched 04:24:23.985411 run osmo-stp_10.42.42.5(pid=8362): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] 04:24:24.121695 run osmo-stp_10.42.42.5(pid=8362): stdout: | (launched: 2022-12-14_04:24:22.408120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:24.256708 run osmo-stp_10.42.42.5(pid=8362): stderr: | [0;m[38;5;43m20221214042422737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042422737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042422738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042422738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042422738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042422738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042422739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:24.393325 run osmo-stp_10.42.42.5(pid=8362): stdout: | (launched: 2022-12-14_04:24:22.408120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:24.521665 run osmo-stp_10.42.42.5(pid=8362): stderr: | [0;m[38;5;43m20221214042422737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042422737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042422738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042422738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042422738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042422738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042422739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:24.675398 run patchelf(pid=8365): Terminating (SIGINT) 04:24:24.851811 run patchelf(pid=8365): Terminated: ok {rc=0} 04:24:24.979824 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8362): Process ended prematurely: osmo-stp_10.42.42.5(pid=8362) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:24:24.990743 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 04:24:25.019704 run osmo-hlr_10.42.42.2(pid=8359): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8359)] 04:24:25.070135 run osmo-hlr_10.42.42.2(pid=8359): stdout: | (launched: 2022-12-14_04:24:21.131940) 04:24:25.121901 run osmo-hlr_10.42.42.2(pid=8359): stderr: | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042421465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042421483 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042421499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042421499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042421499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:25.175492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8352): Terminating (SIGTERM) 04:24:25.218449 run iperf3-srv_10.42.42.10(pid=8353): Terminating (SIGTERM) 04:24:25.263579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Terminating (SIGTERM) 04:24:25.306336 run iperf3-srv_10.42.42.10(pid=8355): Terminating (SIGTERM) 04:24:25.352740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Terminating (SIGTERM) 04:24:25.395719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Terminating (SIGTERM) 04:24:25.439923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8364): Terminating (SIGTERM) 04:24:25.484303 --- ParallelTerminationStrategy: PID 8352 died... 04:24:25.505184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8352): Terminated: ok {rc=0} 04:24:25.554974 --- ParallelTerminationStrategy: PID 8353 died... 04:24:25.575556 run iperf3-srv_10.42.42.10(pid=8353): Terminated {rc=256} 04:24:25.622766 --- ParallelTerminationStrategy: PID 8354 died... 04:24:25.643949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8354): Terminated: ok {rc=0} 04:24:25.690398 --- ParallelTerminationStrategy: PID 8355 died... 04:24:25.711380 run iperf3-srv_10.42.42.10(pid=8355): Terminated {rc=256} 04:24:25.758872 --- ParallelTerminationStrategy: PID 8358 died... 04:24:25.779628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8358): Terminated: ok {rc=0} 04:24:25.826361 --- ParallelTerminationStrategy: PID 8361 died... 04:24:25.846950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8361): Terminated: ok {rc=0} 04:24:25.894193 --- ParallelTerminationStrategy: PID 8364 died... 04:24:25.917847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8364): Terminated: ok {rc=0} 04:24:26.008421 bus /gobi_0: Setting Powered False 04:24:27.107340 bus /gobi_0: Setting Powered False 04:24:28.223230 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:24:29.365140 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.376550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:29.426885 tst iperf3.py: using LAC 38526 04:24:29.548092 tst iperf3.py: using RAC 21 04:24:29.677451 tst iperf3.py: using CellId 38526 04:24:29.800479 tst iperf3.py: using BVCI 38527 04:24:29.911248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.922361 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.932939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.943586 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.954134 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.965454 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.976162 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.987162 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:29.997893 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:30.118278 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:30.336717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:30.661536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8366): Launched 04:24:30.971796 run iperf3-srv_10.42.42.10(pid=8367): Launched 04:24:31.106035 tst iperf3.py:8: start network... 04:24:31.312389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:31.796883 run create_hlr_db(pid=8368): Launched 04:24:31.946751 bus /gobi_6: Setting Powered False 04:24:33.007489 run create_hlr_db(pid=8368): Terminated: ok {rc=0} 04:24:33.453402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8370): Launched 04:24:33.779391 run osmo-hlr_10.42.42.2(pid=8371): Launched 04:24:33.903842 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:34.464817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8373): Launched 04:24:34.790613 run osmo-stp_10.42.42.5(pid=8374): Launched 04:24:34.914145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:35.471733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8376): Launched 04:24:35.597489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:35.871013 run patchelf(pid=8377): Launched 04:24:36.051419 run osmo-stp_10.42.42.5(pid=8374): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8374)] 04:24:36.187859 run osmo-stp_10.42.42.5(pid=8374): stdout: | (launched: 2022-12-14_04:24:34.730552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:36.325957 run osmo-stp_10.42.42.5(pid=8374): stderr: | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042434921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:36.464116 run osmo-stp_10.42.42.5(pid=8374): stdout: | (launched: 2022-12-14_04:24:34.730552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:36.597076 run osmo-stp_10.42.42.5(pid=8374): stderr: | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042434921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042434921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042434922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:36.754048 run patchelf(pid=8377): Terminating (SIGINT) 04:24:36.934329 run patchelf(pid=8377): Terminated: ok {rc=0} 04:24:37.064351 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8374): Process ended prematurely: osmo-stp_10.42.42.5(pid=8374) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8374)] [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 04:24:37.074685 tst iperf3.py:8: Test FAILED (7.7 sec) 04:24:37.103334 run osmo-hlr_10.42.42.2(pid=8371): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8371)] 04:24:37.153897 run osmo-hlr_10.42.42.2(pid=8371): stdout: | (launched: 2022-12-14_04:24:33.719787) 04:24:37.206058 run osmo-hlr_10.42.42.2(pid=8371): stderr: | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042433916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042433929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042433937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042433937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042433937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:37.258651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8366): Terminating (SIGTERM) 04:24:37.300811 run iperf3-srv_10.42.42.10(pid=8367): Terminating (SIGTERM) 04:24:37.342669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8370): Terminating (SIGTERM) 04:24:37.385168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8373): Terminating (SIGTERM) 04:24:37.427579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8376): Terminating (SIGTERM) 04:24:37.469776 --- ParallelTerminationStrategy: PID 8366 died... 04:24:37.490091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8366): Terminated: ok {rc=0} 04:24:37.536492 --- ParallelTerminationStrategy: PID 8367 died... 04:24:37.556685 run iperf3-srv_10.42.42.10(pid=8367): Terminated {rc=256} 04:24:37.602790 --- ParallelTerminationStrategy: PID 8370 died... 04:24:37.622703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8370): Terminated: ok {rc=0} 04:24:37.669086 --- ParallelTerminationStrategy: PID 8373 died... 04:24:37.688807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8373): Terminated: ok {rc=0} 04:24:37.735022 --- ParallelTerminationStrategy: PID 8376 died... 04:24:37.754891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8376): Terminated: ok {rc=0} 04:24:37.843712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:24:38.992056 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.003716 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:39.056760 tst iperf3m4.py: using LAC 38527 04:24:39.184146 tst iperf3m4.py: using RAC 22 04:24:39.310591 tst iperf3m4.py: using CellId 38527 04:24:39.436141 tst iperf3m4.py: using BVCI 38528 04:24:39.554273 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.566083 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.577359 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.588279 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.600012 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.611820 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.623831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.635686 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:39.647647 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:39.769973 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:39.889429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:40.011709 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:24:40.132605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:24:40.350727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:40.676178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Launched 04:24:40.959347 run iperf3-srv_10.42.42.10(pid=8379): Launched 04:24:41.082705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:24:41.300216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:41.626678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Launched 04:24:41.910476 run iperf3-srv_10.42.42.10(pid=8381): Launched 04:24:42.033826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:24:42.251554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:42.577720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Launched 04:24:42.860790 run iperf3-srv_10.42.42.10(pid=8383): Launched 04:24:42.984353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:24:43.202791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:24:43.529317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Launched 04:24:43.812523 run iperf3-srv_10.42.42.10(pid=8385): Launched 04:24:43.936940 tst iperf3m4.py:8: start network... 04:24:44.155281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:24:44.660933 run create_hlr_db(pid=8386): Launched 04:24:44.785618 bus /gobi_6: Setting Powered False 04:24:45.857876 run create_hlr_db(pid=8386): Terminated: ok {rc=0} 04:24:46.353945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8388): Launched 04:24:46.677675 run osmo-hlr_10.42.42.2(pid=8389): Launched 04:24:46.794009 run osmo-stp_10.42.42.5: Starting osmo-stp 04:24:47.614623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8391): Launched 04:24:47.941334 run osmo-stp_10.42.42.5(pid=8392): Launched 04:24:48.066575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:24:48.626419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8394): Launched 04:24:48.750429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:24:49.024257 run patchelf(pid=8395): Launched 04:24:49.205335 run osmo-stp_10.42.42.5(pid=8392): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8392)] 04:24:49.342738 run osmo-stp_10.42.42.5(pid=8392): stdout: | (launched: 2022-12-14_04:24:47.881598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:49.481714 run osmo-stp_10.42.42.5(pid=8392): stderr: | [0;m[38;5;43m20221214042448070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042448070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042448071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042448071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:49.620537 run osmo-stp_10.42.42.5(pid=8392): stdout: | (launched: 2022-12-14_04:24:47.881598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:24:49.753515 run osmo-stp_10.42.42.5(pid=8392): stderr: | [0;m[38;5;43m20221214042448070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042448070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042448071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042448071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:24:49.911800 run patchelf(pid=8395): Terminating (SIGINT) 04:24:50.092822 run patchelf(pid=8395): Terminated: ok {rc=0} 04:24:50.223824 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8392): Process ended prematurely: osmo-stp_10.42.42.5(pid=8392) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8392)] [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 04:24:50.234156 tst iperf3m4.py:8: Test FAILED (11.3 sec) 04:24:50.262893 run osmo-hlr_10.42.42.2(pid=8389): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8389)] 04:24:50.313764 run osmo-hlr_10.42.42.2(pid=8389): stdout: | (launched: 2022-12-14_04:24:46.620598) 04:24:50.365813 run osmo-hlr_10.42.42.2(pid=8389): stderr: | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042446931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042446946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042446966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042446967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042446967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:24:50.418133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminating (SIGTERM) 04:24:50.460000 run iperf3-srv_10.42.42.10(pid=8379): Terminating (SIGTERM) 04:24:50.501720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminating (SIGTERM) 04:24:50.543625 run iperf3-srv_10.42.42.10(pid=8381): Terminating (SIGTERM) 04:24:50.585617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Terminating (SIGTERM) 04:24:50.628182 run iperf3-srv_10.42.42.10(pid=8383): Terminating (SIGTERM) 04:24:50.670240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Terminating (SIGTERM) 04:24:50.712565 run iperf3-srv_10.42.42.10(pid=8385): Terminating (SIGTERM) 04:24:50.754277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8388): Terminating (SIGTERM) 04:24:50.796287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8391): Terminating (SIGTERM) 04:24:50.838515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8394): Terminating (SIGTERM) 04:24:50.880511 --- ParallelTerminationStrategy: PID 8378 died... 04:24:50.900787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminated: ok {rc=0} 04:24:50.946860 --- ParallelTerminationStrategy: PID 8379 died... 04:24:50.966626 run iperf3-srv_10.42.42.10(pid=8379): Terminated {rc=256} 04:24:51.012481 --- ParallelTerminationStrategy: PID 8380 died... 04:24:51.032217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminated: ok {rc=0} 04:24:51.078085 --- ParallelTerminationStrategy: PID 8381 died... 04:24:51.097802 run iperf3-srv_10.42.42.10(pid=8381): Terminated {rc=256} 04:24:51.143781 --- ParallelTerminationStrategy: PID 8382 died... 04:24:51.163388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8382): Terminated: ok {rc=0} 04:24:51.209426 --- ParallelTerminationStrategy: PID 8383 died... 04:24:51.229222 run iperf3-srv_10.42.42.10(pid=8383): Terminated {rc=256} 04:24:51.275121 --- ParallelTerminationStrategy: PID 8384 died... 04:24:51.294842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8384): Terminated: ok {rc=0} 04:24:51.340896 --- ParallelTerminationStrategy: PID 8385 died... 04:24:51.361153 run iperf3-srv_10.42.42.10(pid=8385): Terminated {rc=256} 04:24:51.407099 --- ParallelTerminationStrategy: PID 8388 died... 04:24:51.426919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8388): Terminated: ok {rc=0} 04:24:51.472905 --- ParallelTerminationStrategy: PID 8391 died... 04:24:51.493144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8391): Terminated: ok {rc=0} 04:24:51.539596 --- ParallelTerminationStrategy: PID 8394 died... 04:24:51.559820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8394): Terminated: ok {rc=0} 04:24:51.648157 bus /gobi_4: Setting Powered False 04:24:52.746009 bus /gobi_4: Setting Powered False 04:24:53.861269 bus /gobi_1: Setting Powered False 04:24:54.960676 bus /gobi_1: Setting Powered False 04:24:56.079281 bus /gobi_0: Setting Powered False 04:24:57.178745 bus /gobi_0: Setting Powered False 04:24:58.293724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 04:24:59.396015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:59.407953 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:24:59.459777 tst ping.py: using LAC 38528 04:24:59.586926 tst ping.py: using RAC 23 04:24:59.710826 tst ping.py: using CellId 38528 04:24:59.836437 tst ping.py: using BVCI 38529 04:24:59.952355 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:59.963796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:59.974902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:59.985984 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:24:59.997306 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:00.008541 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:00.020113 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:00.031464 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:25:00.146913 tst ping.py:19: start network... 04:25:00.343999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:00.803143 run create_hlr_db(pid=8396): Launched 04:25:00.978406 bus /gobi_6: Setting Powered False 04:25:02.082898 run create_hlr_db(pid=8396): Terminated: ok {rc=0} 04:25:02.570807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Launched 04:25:02.868884 run osmo-hlr_10.42.42.2(pid=8402): Launched 04:25:02.980777 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:03.508404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Launched 04:25:03.804427 run osmo-stp_10.42.42.5(pid=8405): Launched 04:25:03.918219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:04.430232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Launched 04:25:04.543403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:04.793739 run patchelf(pid=8408): Launched 04:25:04.958061 run osmo-stp_10.42.42.5(pid=8405): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] 04:25:05.084222 run osmo-stp_10.42.42.5(pid=8405): stdout: | (launched: 2022-12-14_04:25:03.749100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:05.211661 run osmo-stp_10.42.42.5(pid=8405): stderr: | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042503916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042503916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:05.339375 run osmo-stp_10.42.42.5(pid=8405): stdout: | (launched: 2022-12-14_04:25:03.749100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:05.460234 run osmo-stp_10.42.42.5(pid=8405): stderr: | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042503916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042503916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:05.604074 run patchelf(pid=8408): Terminating (SIGINT) 04:25:05.769652 run patchelf(pid=8408): Terminated: ok {rc=0} 04:25:05.888567 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8405): Process ended prematurely: osmo-stp_10.42.42.5(pid=8405) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 04:25:05.897876 tst ping.py:22: Test FAILED (6.5 sec) 04:25:05.924782 run osmo-hlr_10.42.42.2(pid=8402): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8402)] 04:25:05.972127 run osmo-hlr_10.42.42.2(pid=8402): stdout: | (launched: 2022-12-14_04:25:02.814140) 04:25:06.021106 run osmo-hlr_10.42.42.2(pid=8402): stderr: | [0;m[1;31m20221214042502989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042502989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042502989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042502990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042502990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042502990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042503002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042503010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042503011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042503011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:06.070604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Terminating (SIGTERM) 04:25:06.110585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Terminating (SIGTERM) 04:25:06.150003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Terminating (SIGTERM) 04:25:06.189718 --- ParallelTerminationStrategy: PID 8401 died... 04:25:06.208587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8401): Terminated: ok {rc=0} 04:25:06.252513 --- ParallelTerminationStrategy: PID 8404 died... 04:25:06.271134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8404): Terminated: ok {rc=0} 04:25:06.314492 --- ParallelTerminationStrategy: PID 8407 died... 04:25:06.333104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8407): Terminated: ok {rc=0} 04:25:06.415938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:25:07.502561 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:07.515154 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:25:07.567539 tst ping_idle_ping.py: using LAC 38529 04:25:07.694148 tst ping_idle_ping.py: using RAC 24 04:25:07.818690 tst ping_idle_ping.py: using CellId 38529 04:25:07.942918 tst ping_idle_ping.py: using BVCI 38530 04:25:08.060452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.071921 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.083426 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.094646 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.106035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.117401 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.128882 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:25:08.140413 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:25:08.255712 tst ping_idle_ping.py:24: start network... 04:25:08.453258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:08.913402 run create_hlr_db(pid=8410): Launched 04:25:09.035678 bus /gobi_6: Setting Powered False 04:25:10.094951 run create_hlr_db(pid=8410): Terminated: ok {rc=0} 04:25:10.531801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8412): Launched 04:25:10.852363 run osmo-hlr_10.42.42.2(pid=8413): Launched 04:25:10.973955 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:11.523542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8415): Launched 04:25:11.844223 run osmo-stp_10.42.42.5(pid=8416): Launched 04:25:11.967216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:12.516710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8418): Launched 04:25:12.640656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:12.910939 run patchelf(pid=8419): Launched 04:25:13.089141 run osmo-stp_10.42.42.5(pid=8416): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8416)] 04:25:13.224217 run osmo-stp_10.42.42.5(pid=8416): stdout: | (launched: 2022-12-14_04:25:11.785612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:13.361736 run osmo-stp_10.42.42.5(pid=8416): stderr: | [0;m[38;5;43m20221214042511977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042511977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042511978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042511978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:13.499228 run osmo-stp_10.42.42.5(pid=8416): stdout: | (launched: 2022-12-14_04:25:11.785612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:13.630908 run osmo-stp_10.42.42.5(pid=8416): stderr: | [0;m[38;5;43m20221214042511977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042511977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042511978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042511978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042511979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:13.786005 run patchelf(pid=8419): Terminating (SIGINT) 04:25:13.963982 run patchelf(pid=8419): Terminated: ok {rc=0} 04:25:14.092789 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8416): Process ended prematurely: osmo-stp_10.42.42.5(pid=8416) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8416)] [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 04:25:14.102548 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:25:14.130645 run osmo-hlr_10.42.42.2(pid=8413): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8413)] 04:25:14.181339 run osmo-hlr_10.42.42.2(pid=8413): stdout: | (launched: 2022-12-14_04:25:10.793912) 04:25:14.233217 run osmo-hlr_10.42.42.2(pid=8413): stderr: | [0;m[1;31m20221214042510990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042510990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042510991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042510991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042510991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042510991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042511006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042511015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042511015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042511015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:14.286109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8412): Terminating (SIGTERM) 04:25:14.327900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8415): Terminating (SIGTERM) 04:25:14.369993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8418): Terminating (SIGTERM) 04:25:14.412257 --- ParallelTerminationStrategy: PID 8412 died... 04:25:14.432783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8412): Terminated: ok {rc=0} 04:25:14.479210 --- ParallelTerminationStrategy: PID 8415 died... 04:25:14.499292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8415): Terminated: ok {rc=0} 04:25:14.546332 --- ParallelTerminationStrategy: PID 8418 died... 04:25:14.566276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8418): Terminated: ok {rc=0} 04:25:14.655680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:25:15.985397 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:25:15.992597 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:25:16.029400 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:25:16.071419 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:25:16.163957 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:25:16.222225 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:25:16.266743 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:25:16.837663 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:25:16.889858 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:16.901637 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:16.973425 tst cs_paging_gprs_active.py: using LAC 38530 04:25:17.094539 tst cs_paging_gprs_active.py: using RAC 25 04:25:17.250286 tst cs_paging_gprs_active.py: using CellId 38530 04:25:17.391046 tst cs_paging_gprs_active.py: using BVCI 38531 04:25:17.510205 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.521669 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.533350 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.544612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.556577 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.568615 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.581092 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.593196 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:17.605460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:17.722328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:17.837418 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:25:18.040216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:18.343943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8423): Launched 04:25:18.608102 run iperf3-srv_10.42.42.10(pid=8424): Launched 04:25:18.720564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:25:18.921761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:19.224283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8425): Launched 04:25:19.487284 run iperf3-srv_10.42.42.10(pid=8426): Launched 04:25:19.599970 tst cs_paging_gprs_active.py:38: start network... 04:25:19.801134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:20.270493 run create_hlr_db(pid=8427): Launched 04:25:20.395257 bus /gobi_6: Setting Powered False 04:25:21.455619 run create_hlr_db(pid=8427): Terminated: ok {rc=0} 04:25:21.898097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8429): Launched 04:25:22.224393 run osmo-hlr_10.42.42.2(pid=8430): Launched 04:25:22.349543 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:22.907590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8432): Launched 04:25:23.232224 run osmo-stp_10.42.42.5(pid=8433): Launched 04:25:23.356770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:23.916233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8435): Launched 04:25:24.041696 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:24.323190 run patchelf(pid=8436): Launched 04:25:24.505807 run osmo-stp_10.42.42.5(pid=8433): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8433)] 04:25:24.643853 run osmo-stp_10.42.42.5(pid=8433): stdout: | (launched: 2022-12-14_04:25:23.172471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:24.783185 run osmo-stp_10.42.42.5(pid=8433): stderr: | [0;m[38;5;43m20221214042523363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042523363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042523364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042523364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042523364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042523365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042523365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:24.922503 run osmo-stp_10.42.42.5(pid=8433): stdout: | (launched: 2022-12-14_04:25:23.172471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:25.055652 run osmo-stp_10.42.42.5(pid=8433): stderr: | [0;m[38;5;43m20221214042523363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042523363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042523364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042523364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042523364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042523365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042523365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:25.213508 run patchelf(pid=8436): Terminating (SIGINT) 04:25:25.395281 run patchelf(pid=8436): Terminated: ok {rc=0} 04:25:25.526481 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8433): Process ended prematurely: osmo-stp_10.42.42.5(pid=8433) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8433)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:25:25.537332 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:25:25.566147 run osmo-hlr_10.42.42.2(pid=8430): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8430)] 04:25:25.617147 run osmo-hlr_10.42.42.2(pid=8430): stdout: | (launched: 2022-12-14_04:25:22.164761) 04:25:25.669332 run osmo-hlr_10.42.42.2(pid=8430): stderr: | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042522360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042522378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042522387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042522387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042522387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:25.721897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8423): Terminating (SIGTERM) 04:25:25.763833 run iperf3-srv_10.42.42.10(pid=8424): Terminating (SIGTERM) 04:25:25.806404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8425): Terminating (SIGTERM) 04:25:25.848442 run iperf3-srv_10.42.42.10(pid=8426): Terminating (SIGTERM) 04:25:25.890706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8429): Terminating (SIGTERM) 04:25:25.932488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8432): Terminating (SIGTERM) 04:25:25.974319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8435): Terminating (SIGTERM) 04:25:26.016863 --- ParallelTerminationStrategy: PID 8423 died... 04:25:26.037350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8423): Terminated: ok {rc=0} 04:25:26.083853 --- ParallelTerminationStrategy: PID 8424 died... 04:25:26.103693 run iperf3-srv_10.42.42.10(pid=8424): Terminated {rc=256} 04:25:26.149850 --- ParallelTerminationStrategy: PID 8425 died... 04:25:26.169708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8425): Terminated: ok {rc=0} 04:25:26.215874 --- ParallelTerminationStrategy: PID 8426 died... 04:25:26.235644 run iperf3-srv_10.42.42.10(pid=8426): Terminated {rc=256} 04:25:26.281601 --- ParallelTerminationStrategy: PID 8429 died... 04:25:26.301465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8429): Terminated: ok {rc=0} 04:25:26.347541 --- ParallelTerminationStrategy: PID 8432 died... 04:25:26.367275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8432): Terminated: ok {rc=0} 04:25:26.413404 --- ParallelTerminationStrategy: PID 8435 died... 04:25:26.433175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8435): Terminated: ok {rc=0} 04:25:26.520295 bus /gobi_0: Setting Powered False 04:25:27.620889 bus /gobi_0: Setting Powered False 04:25:28.737179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:25:29.884940 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:29.896909 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:29.967901 tst iperf3.py: using LAC 38531 04:25:30.095704 tst iperf3.py: using RAC 26 04:25:30.221986 tst iperf3.py: using CellId 38531 04:25:30.350510 tst iperf3.py: using BVCI 38532 04:25:30.461390 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.472601 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.483504 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.494248 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.505586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.516763 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.528340 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.539783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:30.551141 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:30.671319 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:30.904026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:31.238306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8437): Launched 04:25:31.519318 run iperf3-srv_10.42.42.10(pid=8438): Launched 04:25:31.683338 tst iperf3.py:8: start network... 04:25:31.949858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:32.506782 run create_hlr_db(pid=8439): Launched 04:25:32.631241 bus /gobi_6: Setting Powered False 04:25:33.694708 run create_hlr_db(pid=8439): Terminated: ok {rc=0} 04:25:34.126050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Launched 04:25:34.430013 run osmo-hlr_10.42.42.2(pid=8442): Launched 04:25:34.545851 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:35.083992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Launched 04:25:35.385967 run osmo-stp_10.42.42.5(pid=8445): Launched 04:25:35.500421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:36.023918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8447): Launched 04:25:36.140291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:36.395443 run patchelf(pid=8448): Launched 04:25:36.562648 run osmo-stp_10.42.42.5(pid=8445): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] 04:25:36.690064 run osmo-stp_10.42.42.5(pid=8445): stdout: | (launched: 2022-12-14_04:25:35.330141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:36.818783 run osmo-stp_10.42.42.5(pid=8445): stderr: | [0;m[38;5;43m20221214042535498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042535499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042535499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042535499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:36.947670 run osmo-stp_10.42.42.5(pid=8445): stdout: | (launched: 2022-12-14_04:25:35.330141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:37.071037 run osmo-stp_10.42.42.5(pid=8445): stderr: | [0;m[38;5;43m20221214042535498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042535499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042535499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042535499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042535500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:37.217126 run patchelf(pid=8448): Terminating (SIGINT) 04:25:37.385715 run patchelf(pid=8448): Terminated: ok {rc=0} 04:25:37.506832 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8445): Process ended prematurely: osmo-stp_10.42.42.5(pid=8445) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 04:25:37.516208 tst iperf3.py:8: Test FAILED (7.7 sec) 04:25:37.543532 run osmo-hlr_10.42.42.2(pid=8442): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8442)] 04:25:37.591200 run osmo-hlr_10.42.42.2(pid=8442): stdout: | (launched: 2022-12-14_04:25:34.373647) 04:25:37.641058 run osmo-hlr_10.42.42.2(pid=8442): stderr: | [0;m[1;31m20221214042534548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042534549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042534549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042534549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042534549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042534549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042534561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042534570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042534570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042534570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:37.690817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8437): Terminating (SIGTERM) 04:25:37.730909 run iperf3-srv_10.42.42.10(pid=8438): Terminating (SIGTERM) 04:25:37.770562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Terminating (SIGTERM) 04:25:37.810205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Terminating (SIGTERM) 04:25:37.849627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8447): Terminating (SIGTERM) 04:25:37.889514 --- ParallelTerminationStrategy: PID 8437 died... 04:25:37.908745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8437): Terminated: ok {rc=0} 04:25:37.952535 --- ParallelTerminationStrategy: PID 8438 died... 04:25:37.971377 run iperf3-srv_10.42.42.10(pid=8438): Terminated {rc=256} 04:25:38.014930 --- ParallelTerminationStrategy: PID 8441 died... 04:25:38.033616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8441): Terminated: ok {rc=0} 04:25:38.077228 --- ParallelTerminationStrategy: PID 8444 died... 04:25:38.095732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8444): Terminated: ok {rc=0} 04:25:38.139569 --- ParallelTerminationStrategy: PID 8447 died... 04:25:38.158746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8447): Terminated: ok {rc=0} 04:25:38.243166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:25:39.394012 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:39.406288 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:39.479034 tst iperf3m4.py: using LAC 38532 04:25:39.607541 tst iperf3m4.py: using RAC 27 04:25:39.734398 tst iperf3m4.py: using CellId 38532 04:25:39.861081 tst iperf3m4.py: using BVCI 38533 04:25:39.979442 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:39.991157 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.002618 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.014011 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.025789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.037693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.049713 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.061529 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:40.073537 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:40.195107 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:40.314656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:40.433853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:40.550602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:25:40.752846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:41.056038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Launched 04:25:41.319420 run iperf3-srv_10.42.42.10(pid=8450): Launched 04:25:41.432439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:25:41.633639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:41.937298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8451): Launched 04:25:42.200630 run iperf3-srv_10.42.42.10(pid=8452): Launched 04:25:42.313622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:25:42.513585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:42.815709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8453): Launched 04:25:43.077561 run iperf3-srv_10.42.42.10(pid=8454): Launched 04:25:43.190915 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:25:43.391657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:25:43.694905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8455): Launched 04:25:43.959089 run iperf3-srv_10.42.42.10(pid=8456): Launched 04:25:44.073721 tst iperf3m4.py:8: start network... 04:25:44.274886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:25:44.743795 run create_hlr_db(pid=8457): Launched 04:25:44.868469 bus /gobi_6: Setting Powered False 04:25:45.952010 run create_hlr_db(pid=8457): Terminated: ok {rc=0} 04:25:46.415580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8459): Launched 04:25:46.762865 run osmo-hlr_10.42.42.2(pid=8460): Launched 04:25:47.011407 run osmo-stp_10.42.42.5: Starting osmo-stp 04:25:47.585339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8462): Launched 04:25:47.885235 run osmo-stp_10.42.42.5(pid=8463): Launched 04:25:47.999143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:25:48.519633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8465): Launched 04:25:48.636259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:25:48.890244 run patchelf(pid=8466): Launched 04:25:49.056632 run osmo-stp_10.42.42.5(pid=8463): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8463)] 04:25:49.183363 run osmo-stp_10.42.42.5(pid=8463): stdout: | (launched: 2022-12-14_04:25:47.829161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:49.311445 run osmo-stp_10.42.42.5(pid=8463): stderr: | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042547998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:49.439578 run osmo-stp_10.42.42.5(pid=8463): stdout: | (launched: 2022-12-14_04:25:47.829161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:25:49.562219 run osmo-stp_10.42.42.5(pid=8463): stderr: | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042547997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042547998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042547998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:25:49.708322 run patchelf(pid=8466): Terminating (SIGINT) 04:25:49.876225 run patchelf(pid=8466): Terminated: ok {rc=0} 04:25:49.997061 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8463): Process ended prematurely: osmo-stp_10.42.42.5(pid=8463) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8463)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:25:50.006517 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:25:50.033898 run osmo-hlr_10.42.42.2(pid=8460): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8460)] 04:25:50.081184 run osmo-hlr_10.42.42.2(pid=8460): stdout: | (launched: 2022-12-14_04:25:46.701272) 04:25:50.130196 run osmo-hlr_10.42.42.2(pid=8460): stderr: | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042547006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042547023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042547033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042547034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042547034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:25:50.179372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Terminating (SIGTERM) 04:25:50.218979 run iperf3-srv_10.42.42.10(pid=8450): Terminating (SIGTERM) 04:25:50.258874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8451): Terminating (SIGTERM) 04:25:50.298780 run iperf3-srv_10.42.42.10(pid=8452): Terminating (SIGTERM) 04:25:50.338121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8453): Terminating (SIGTERM) 04:25:50.377646 run iperf3-srv_10.42.42.10(pid=8454): Terminating (SIGTERM) 04:25:50.417031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8455): Terminating (SIGTERM) 04:25:50.456481 run iperf3-srv_10.42.42.10(pid=8456): Terminating (SIGTERM) 04:25:50.495830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8459): Terminating (SIGTERM) 04:25:50.535310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8462): Terminating (SIGTERM) 04:25:50.574771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8465): Terminating (SIGTERM) 04:25:50.614527 --- ParallelTerminationStrategy: PID 8449 died... 04:25:50.633636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8449): Terminated: ok {rc=0} 04:25:50.677610 --- ParallelTerminationStrategy: PID 8450 died... 04:25:50.696294 run iperf3-srv_10.42.42.10(pid=8450): Terminated {rc=256} 04:25:50.740303 --- ParallelTerminationStrategy: PID 8451 died... 04:25:50.759150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8451): Terminated: ok {rc=0} 04:25:50.802816 --- ParallelTerminationStrategy: PID 8452 died... 04:25:50.821380 run iperf3-srv_10.42.42.10(pid=8452): Terminated {rc=256} 04:25:50.865131 --- ParallelTerminationStrategy: PID 8453 died... 04:25:50.883695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8453): Terminated: ok {rc=0} 04:25:50.927480 --- ParallelTerminationStrategy: PID 8454 died... 04:25:50.946174 run iperf3-srv_10.42.42.10(pid=8454): Terminated {rc=256} 04:25:50.989765 --- ParallelTerminationStrategy: PID 8455 died... 04:25:51.008395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8455): Terminated: ok {rc=0} 04:25:51.052075 --- ParallelTerminationStrategy: PID 8456 died... 04:25:51.070899 run iperf3-srv_10.42.42.10(pid=8456): Terminated {rc=256} 04:25:51.114685 --- ParallelTerminationStrategy: PID 8459 died... 04:25:51.133469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8459): Terminated: ok {rc=0} 04:25:51.177435 --- ParallelTerminationStrategy: PID 8462 died... 04:25:51.195957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8462): Terminated: ok {rc=0} 04:25:51.239897 --- ParallelTerminationStrategy: PID 8465 died... 04:25:51.258579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8465): Terminated: ok {rc=0} 04:25:51.343204 bus /gobi_4: Setting Powered False 04:25:52.443757 bus /gobi_4: Setting Powered False 04:25:53.555430 bus /gobi_1: Setting Powered False 04:25:54.650055 bus /gobi_1: Setting Powered False 04:25:55.763185 bus /gobi_0: Setting Powered False 04:25:56.858916 bus /gobi_0: Setting Powered False 04:25:57.975155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:25:59.078362 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.090126 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:25:59.160124 tst ping.py: using LAC 38533 04:25:59.276069 tst ping.py: using RAC 28 04:25:59.393360 tst ping.py: using CellId 38533 04:25:59.513590 tst ping.py: using BVCI 38534 04:25:59.622202 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.633084 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.643710 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.654406 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.664917 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.675989 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.686933 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:25:59.697773 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:25:59.812395 tst ping.py:19: start network... 04:26:00.009745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:00.469096 run create_hlr_db(pid=8468): Launched 04:26:00.594510 bus /gobi_6: Setting Powered False 04:26:01.675822 run create_hlr_db(pid=8468): Terminated: ok {rc=0} 04:26:02.169159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8470): Launched 04:26:02.480365 run osmo-hlr_10.42.42.2(pid=8471): Launched 04:26:02.593602 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:03.109829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8473): Launched 04:26:03.407509 run osmo-stp_10.42.42.5(pid=8474): Launched 04:26:03.522177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:04.034212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8476): Launched 04:26:04.150045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:04.401235 run patchelf(pid=8477): Launched 04:26:04.566684 run osmo-stp_10.42.42.5(pid=8474): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8474)] 04:26:04.691641 run osmo-stp_10.42.42.5(pid=8474): stdout: | (launched: 2022-12-14_04:26:03.351920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:04.818708 run osmo-stp_10.42.42.5(pid=8474): stderr: | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042603523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:04.945396 run osmo-stp_10.42.42.5(pid=8474): stdout: | (launched: 2022-12-14_04:26:03.351920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:05.066466 run osmo-stp_10.42.42.5(pid=8474): stderr: | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042603522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042603523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042603523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:05.210123 run patchelf(pid=8477): Terminating (SIGINT) 04:26:05.375330 run patchelf(pid=8477): Terminated: ok {rc=0} 04:26:05.494395 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8474): Process ended prematurely: osmo-stp_10.42.42.5(pid=8474) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8474)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 04:26:05.503306 tst ping.py:22: Test FAILED (6.4 sec) 04:26:05.530423 run osmo-hlr_10.42.42.2(pid=8471): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8471)] 04:26:05.578162 run osmo-hlr_10.42.42.2(pid=8471): stdout: | (launched: 2022-12-14_04:26:02.425373) 04:26:05.627630 run osmo-hlr_10.42.42.2(pid=8471): stderr: | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042602601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042602613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042602622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042602622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042602622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:05.677602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8470): Terminating (SIGTERM) 04:26:05.717531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8473): Terminating (SIGTERM) 04:26:05.757411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8476): Terminating (SIGTERM) 04:26:05.797810 --- ParallelTerminationStrategy: PID 8470 died... 04:26:05.817450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8470): Terminated: ok {rc=0} 04:26:05.861746 --- ParallelTerminationStrategy: PID 8473 died... 04:26:05.880538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8473): Terminated: ok {rc=0} 04:26:05.925059 --- ParallelTerminationStrategy: PID 8476 died... 04:26:05.943917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8476): Terminated: ok {rc=0} 04:26:06.029417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:26:07.119526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.131823 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:26:07.206997 tst ping_idle_ping.py: using LAC 38534 04:26:07.333923 tst ping_idle_ping.py: using RAC 29 04:26:07.464274 tst ping_idle_ping.py: using CellId 38534 04:26:07.589452 tst ping_idle_ping.py: using BVCI 38535 04:26:07.708322 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.719785 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.731062 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.742309 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.754249 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.766193 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.778250 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:26:07.790592 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:26:07.908750 tst ping_idle_ping.py:24: start network... 04:26:08.107622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:08.574024 run create_hlr_db(pid=8478): Launched 04:26:08.698824 bus /gobi_6: Setting Powered False 04:26:09.759072 run create_hlr_db(pid=8478): Terminated: ok {rc=0} 04:26:10.198504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8480): Launched 04:26:10.519334 run osmo-hlr_10.42.42.2(pid=8481): Launched 04:26:10.642839 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:11.196354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8483): Launched 04:26:11.515275 run osmo-stp_10.42.42.5(pid=8484): Launched 04:26:11.639933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:12.195761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8486): Launched 04:26:12.319859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:12.591662 run patchelf(pid=8487): Launched 04:26:12.771787 run osmo-stp_10.42.42.5(pid=8484): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8484)] 04:26:12.907776 run osmo-stp_10.42.42.5(pid=8484): stdout: | (launched: 2022-12-14_04:26:11.456543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:13.045777 run osmo-stp_10.42.42.5(pid=8484): stderr: | [0;m[38;5;43m20221214042611651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042611651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042611652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042611652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042611652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042611653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042611653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:13.183809 run osmo-stp_10.42.42.5(pid=8484): stdout: | (launched: 2022-12-14_04:26:11.456543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:13.315597 run osmo-stp_10.42.42.5(pid=8484): stderr: | [0;m[38;5;43m20221214042611651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042611651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042611652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042611652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042611652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042611653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042611653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:13.471787 run patchelf(pid=8487): Terminating (SIGINT) 04:26:13.651324 run patchelf(pid=8487): Terminated: ok {rc=0} 04:26:13.780458 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8484): Process ended prematurely: osmo-stp_10.42.42.5(pid=8484) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8484)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:26:13.790209 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:26:13.818595 run osmo-hlr_10.42.42.2(pid=8481): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8481)] 04:26:13.869594 run osmo-hlr_10.42.42.2(pid=8481): stdout: | (launched: 2022-12-14_04:26:10.460530) 04:26:13.921982 run osmo-hlr_10.42.42.2(pid=8481): stderr: | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042610658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042610670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042610678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042610678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042610679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:13.975320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8480): Terminating (SIGTERM) 04:26:14.017388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8483): Terminating (SIGTERM) 04:26:14.059751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8486): Terminating (SIGTERM) 04:26:14.102406 --- ParallelTerminationStrategy: PID 8480 died... 04:26:14.122936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8480): Terminated: ok {rc=0} 04:26:14.169874 --- ParallelTerminationStrategy: PID 8483 died... 04:26:14.190087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8483): Terminated: ok {rc=0} 04:26:14.236900 --- ParallelTerminationStrategy: PID 8486 died... 04:26:14.257129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8486): Terminated: ok {rc=0} 04:26:14.346027 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:26:15.651837 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:26:15.658391 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:26:15.691502 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:26:15.730795 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:26:15.817655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:26:15.852248 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:26:15.909903 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:26:16.508587 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:26:16.565542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:16.577803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:16.654194 tst cs_paging_gprs_active.py: using LAC 38535 04:26:16.808912 tst cs_paging_gprs_active.py: using RAC 30 04:26:16.940843 tst cs_paging_gprs_active.py: using CellId 38535 04:26:17.100093 tst cs_paging_gprs_active.py: using BVCI 38536 04:26:17.237994 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.250280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.262841 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.274920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.287819 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.301365 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.313601 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.324629 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:17.335779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:17.457542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:17.582936 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:26:17.802213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:18.127535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8491): Launched 04:26:18.411206 run iperf3-srv_10.42.42.10(pid=8492): Launched 04:26:18.534275 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:26:18.753738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:19.078797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8493): Launched 04:26:19.362299 run iperf3-srv_10.42.42.10(pid=8494): Launched 04:26:19.485061 tst cs_paging_gprs_active.py:38: start network... 04:26:19.704482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:20.207537 run create_hlr_db(pid=8495): Launched 04:26:20.331536 bus /gobi_6: Setting Powered False 04:26:21.395226 run create_hlr_db(pid=8495): Terminated: ok {rc=0} 04:26:21.846723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Launched 04:26:22.171145 run osmo-hlr_10.42.42.2(pid=8498): Launched 04:26:22.296133 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:22.855027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Launched 04:26:23.181712 run osmo-stp_10.42.42.5(pid=8501): Launched 04:26:23.307071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:23.869049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8503): Launched 04:26:23.993665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:24.268376 run patchelf(pid=8504): Launched 04:26:24.451378 run osmo-stp_10.42.42.5(pid=8501): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] 04:26:24.589089 run osmo-stp_10.42.42.5(pid=8501): stdout: | (launched: 2022-12-14_04:26:23.122014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:24.728297 run osmo-stp_10.42.42.5(pid=8501): stderr: | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042623312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042623312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042623312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042623313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:24.867588 run osmo-stp_10.42.42.5(pid=8501): stdout: | (launched: 2022-12-14_04:26:23.122014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:25.000904 run osmo-stp_10.42.42.5(pid=8501): stderr: | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042623311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042623312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042623312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042623312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042623313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:25.158900 run patchelf(pid=8504): Terminating (SIGINT) 04:26:25.340536 run patchelf(pid=8504): Terminated: ok {rc=0} 04:26:25.472024 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8501): Process ended prematurely: osmo-stp_10.42.42.5(pid=8501) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:26:25.482317 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 04:26:25.510774 run osmo-hlr_10.42.42.2(pid=8498): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8498)] 04:26:25.561270 run osmo-hlr_10.42.42.2(pid=8498): stdout: | (launched: 2022-12-14_04:26:22.111243) 04:26:25.614069 run osmo-hlr_10.42.42.2(pid=8498): stderr: | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042622307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042622318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042622327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042622327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042622327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:25.666733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8491): Terminating (SIGTERM) 04:26:25.708338 run iperf3-srv_10.42.42.10(pid=8492): Terminating (SIGTERM) 04:26:25.750099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8493): Terminating (SIGTERM) 04:26:25.792359 run iperf3-srv_10.42.42.10(pid=8494): Terminating (SIGTERM) 04:26:25.834120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Terminating (SIGTERM) 04:26:25.875690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Terminating (SIGTERM) 04:26:25.918022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8503): Terminating (SIGTERM) 04:26:25.960077 --- ParallelTerminationStrategy: PID 8491 died... 04:26:25.980319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8491): Terminated: ok {rc=0} 04:26:26.026415 --- ParallelTerminationStrategy: PID 8492 died... 04:26:26.046056 run iperf3-srv_10.42.42.10(pid=8492): Terminated {rc=256} 04:26:26.092052 --- ParallelTerminationStrategy: PID 8493 died... 04:26:26.111805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8493): Terminated: ok {rc=0} 04:26:26.157726 --- ParallelTerminationStrategy: PID 8494 died... 04:26:26.177477 run iperf3-srv_10.42.42.10(pid=8494): Terminated {rc=256} 04:26:26.223407 --- ParallelTerminationStrategy: PID 8497 died... 04:26:26.243164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8497): Terminated: ok {rc=0} 04:26:26.289177 --- ParallelTerminationStrategy: PID 8500 died... 04:26:26.309079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8500): Terminated: ok {rc=0} 04:26:26.355265 --- ParallelTerminationStrategy: PID 8503 died... 04:26:26.375141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8503): Terminated: ok {rc=0} 04:26:26.463031 bus /gobi_0: Setting Powered False 04:26:27.560171 bus /gobi_0: Setting Powered False 04:26:28.675294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:26:29.821845 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:29.833528 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:29.906632 tst iperf3.py: using LAC 38536 04:26:30.028804 tst iperf3.py: using RAC 31 04:26:30.150423 tst iperf3.py: using CellId 38536 04:26:30.269068 tst iperf3.py: using BVCI 38537 04:26:30.378628 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.389588 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.400224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.410927 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.421488 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.432160 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.443001 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.453610 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:30.464295 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:30.578188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:26:30.797944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:31.136179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8505): Launched 04:26:31.420338 run iperf3-srv_10.42.42.10(pid=8506): Launched 04:26:31.543326 tst iperf3.py:8: start network... 04:26:31.752869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:32.236792 run create_hlr_db(pid=8507): Launched 04:26:32.361042 bus /gobi_6: Setting Powered False 04:26:33.421929 run create_hlr_db(pid=8507): Terminated: ok {rc=0} 04:26:33.865883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8509): Launched 04:26:34.175017 run osmo-hlr_10.42.42.2(pid=8510): Launched 04:26:34.289413 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:34.817894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8512): Launched 04:26:35.119854 run osmo-stp_10.42.42.5(pid=8513): Launched 04:26:35.234297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:35.754011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8515): Launched 04:26:35.868736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:36.123575 run patchelf(pid=8516): Launched 04:26:36.293186 run osmo-stp_10.42.42.5(pid=8513): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8513)] 04:26:36.420428 run osmo-stp_10.42.42.5(pid=8513): stdout: | (launched: 2022-12-14_04:26:35.063613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:36.549497 run osmo-stp_10.42.42.5(pid=8513): stderr: | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042635236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:36.679792 run osmo-stp_10.42.42.5(pid=8513): stdout: | (launched: 2022-12-14_04:26:35.063613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:36.803241 run osmo-stp_10.42.42.5(pid=8513): stderr: | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042635235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042635236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042635236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:36.949478 run patchelf(pid=8516): Terminating (SIGINT) 04:26:37.118119 run patchelf(pid=8516): Terminated: ok {rc=0} 04:26:37.240843 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8513): Process ended prematurely: osmo-stp_10.42.42.5(pid=8513) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8513)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 04:26:37.250529 tst iperf3.py:8: Test FAILED (7.5 sec) 04:26:37.277928 run osmo-hlr_10.42.42.2(pid=8510): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8510)] 04:26:37.325449 run osmo-hlr_10.42.42.2(pid=8510): stdout: | (launched: 2022-12-14_04:26:34.118494) 04:26:37.374589 run osmo-hlr_10.42.42.2(pid=8510): stderr: | [0;m[1;31m20221214042634291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042634291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042634291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042634291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042634292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042634292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042634304 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042634312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042634313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042634313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:37.424165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8505): Terminating (SIGTERM) 04:26:37.463557 run iperf3-srv_10.42.42.10(pid=8506): Terminating (SIGTERM) 04:26:37.502746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8509): Terminating (SIGTERM) 04:26:37.542095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8512): Terminating (SIGTERM) 04:26:37.581281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8515): Terminating (SIGTERM) 04:26:37.621114 --- ParallelTerminationStrategy: PID 8505 died... 04:26:37.640301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8505): Terminated: ok {rc=0} 04:26:37.684284 --- ParallelTerminationStrategy: PID 8506 died... 04:26:37.703104 run iperf3-srv_10.42.42.10(pid=8506): Terminated {rc=256} 04:26:37.746851 --- ParallelTerminationStrategy: PID 8509 died... 04:26:37.765515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8509): Terminated: ok {rc=0} 04:26:37.809337 --- ParallelTerminationStrategy: PID 8512 died... 04:26:37.828090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8512): Terminated: ok {rc=0} 04:26:37.871857 --- ParallelTerminationStrategy: PID 8515 died... 04:26:37.890639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8515): Terminated: ok {rc=0} 04:26:37.975256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:26:39.129119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.141303 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:39.214435 tst iperf3m4.py: using LAC 38537 04:26:39.342678 tst iperf3m4.py: using RAC 32 04:26:39.469076 tst iperf3m4.py: using CellId 38537 04:26:39.598279 tst iperf3m4.py: using BVCI 38538 04:26:39.718236 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.729666 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.740784 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.751930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.763355 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.774809 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.786406 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.797813 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:39.809402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:39.930747 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:40.051623 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:40.168250 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:40.284684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:26:40.487641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:40.793980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Launched 04:26:41.061678 run iperf3-srv_10.42.42.10(pid=8518): Launched 04:26:41.176369 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:26:41.378660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:41.684213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Launched 04:26:41.948630 run iperf3-srv_10.42.42.10(pid=8520): Launched 04:26:42.062116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:26:42.263621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:42.568888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Launched 04:26:42.832705 run iperf3-srv_10.42.42.10(pid=8522): Launched 04:26:42.946462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:26:43.148034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:26:43.452739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8523): Launched 04:26:43.716519 run iperf3-srv_10.42.42.10(pid=8524): Launched 04:26:43.830013 tst iperf3m4.py:8: start network... 04:26:44.030915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:26:44.501127 run create_hlr_db(pid=8525): Launched 04:26:44.625941 bus /gobi_6: Setting Powered False 04:26:45.685932 run create_hlr_db(pid=8525): Terminated: ok {rc=0} 04:26:46.134928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Launched 04:26:46.500935 run osmo-hlr_10.42.42.2(pid=8528): Launched 04:26:46.843032 run osmo-stp_10.42.42.5: Starting osmo-stp 04:26:47.519708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Launched 04:26:47.824002 run osmo-stp_10.42.42.5(pid=8531): Launched 04:26:47.938513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:26:48.458505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8533): Launched 04:26:48.575175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:26:48.831624 run patchelf(pid=8534): Launched 04:26:49.000497 run osmo-stp_10.42.42.5(pid=8531): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] 04:26:49.127922 run osmo-stp_10.42.42.5(pid=8531): stdout: | (launched: 2022-12-14_04:26:47.767506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:49.256749 run osmo-stp_10.42.42.5(pid=8531): stderr: | [0;m[38;5;43m20221214042647935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042647936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:49.385697 run osmo-stp_10.42.42.5(pid=8531): stdout: | (launched: 2022-12-14_04:26:47.767506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:26:49.509357 run osmo-stp_10.42.42.5(pid=8531): stderr: | [0;m[38;5;43m20221214042647935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042647936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:26:49.655948 run patchelf(pid=8534): Terminating (SIGINT) 04:26:49.824269 run patchelf(pid=8534): Terminated: ok {rc=0} 04:26:49.945902 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8531): Process ended prematurely: osmo-stp_10.42.42.5(pid=8531) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:26:49.955347 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:26:49.982969 run osmo-hlr_10.42.42.2(pid=8528): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8528)] 04:26:50.030701 run osmo-hlr_10.42.42.2(pid=8528): stdout: | (launched: 2022-12-14_04:26:46.442466) 04:26:50.080089 run osmo-hlr_10.42.42.2(pid=8528): stderr: | [0;m[1;31m20221214042646638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042646638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042646639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042646639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042646639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042646639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042646653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042646667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042646668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042646668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:26:50.130229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminating (SIGTERM) 04:26:50.169884 run iperf3-srv_10.42.42.10(pid=8518): Terminating (SIGTERM) 04:26:50.209468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminating (SIGTERM) 04:26:50.249190 run iperf3-srv_10.42.42.10(pid=8520): Terminating (SIGTERM) 04:26:50.288781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Terminating (SIGTERM) 04:26:50.328373 run iperf3-srv_10.42.42.10(pid=8522): Terminating (SIGTERM) 04:26:50.367891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8523): Terminating (SIGTERM) 04:26:50.407551 run iperf3-srv_10.42.42.10(pid=8524): Terminating (SIGTERM) 04:26:50.447019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Terminating (SIGTERM) 04:26:50.486510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Terminating (SIGTERM) 04:26:50.526048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8533): Terminating (SIGTERM) 04:26:50.566516 --- ParallelTerminationStrategy: PID 8517 died... 04:26:50.585676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminated: ok {rc=0} 04:26:50.629815 --- ParallelTerminationStrategy: PID 8518 died... 04:26:50.648280 run iperf3-srv_10.42.42.10(pid=8518): Terminated {rc=256} 04:26:50.692317 --- ParallelTerminationStrategy: PID 8519 died... 04:26:50.711103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminated: ok {rc=0} 04:26:50.755461 --- ParallelTerminationStrategy: PID 8520 died... 04:26:50.774177 run iperf3-srv_10.42.42.10(pid=8520): Terminated {rc=256} 04:26:50.817649 --- ParallelTerminationStrategy: PID 8521 died... 04:26:50.836284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Terminated: ok {rc=0} 04:26:50.879892 --- ParallelTerminationStrategy: PID 8522 died... 04:26:50.898534 run iperf3-srv_10.42.42.10(pid=8522): Terminated {rc=256} 04:26:50.942114 --- ParallelTerminationStrategy: PID 8523 died... 04:26:50.960772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8523): Terminated: ok {rc=0} 04:26:51.004601 --- ParallelTerminationStrategy: PID 8524 died... 04:26:51.023367 run iperf3-srv_10.42.42.10(pid=8524): Terminated {rc=256} 04:26:51.066909 --- ParallelTerminationStrategy: PID 8527 died... 04:26:51.085466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8527): Terminated: ok {rc=0} 04:26:51.129345 --- ParallelTerminationStrategy: PID 8530 died... 04:26:51.148123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8530): Terminated: ok {rc=0} 04:26:51.192460 --- ParallelTerminationStrategy: PID 8533 died... 04:26:51.211343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8533): Terminated: ok {rc=0} 04:26:51.297037 bus /gobi_4: Setting Powered False 04:26:52.397394 bus /gobi_4: Setting Powered False 04:26:53.512458 bus /gobi_1: Setting Powered False 04:26:54.612892 bus /gobi_1: Setting Powered False 04:26:55.727863 bus /gobi_0: Setting Powered False 04:26:56.826895 bus /gobi_0: Setting Powered False 04:26:57.944317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:26:59.047070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.059124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:26:59.132434 tst ping.py: using LAC 38538 04:26:59.258153 tst ping.py: using RAC 33 04:26:59.387345 tst ping.py: using CellId 38538 04:26:59.511343 tst ping.py: using BVCI 38539 04:26:59.627654 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.639508 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.650750 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.662010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.673460 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.685082 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.696636 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:26:59.708119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:26:59.823414 tst ping.py:19: start network... 04:27:00.021569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:00.483511 run create_hlr_db(pid=8535): Launched 04:27:00.606052 bus /gobi_6: Setting Powered False 04:27:01.674120 run create_hlr_db(pid=8535): Terminated: ok {rc=0} 04:27:02.105297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8537): Launched 04:27:02.440196 run osmo-hlr_10.42.42.2(pid=8538): Launched 04:27:02.565179 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:03.120513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8540): Launched 04:27:03.442201 run osmo-stp_10.42.42.5(pid=8541): Launched 04:27:03.565221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:04.117275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8543): Launched 04:27:04.239197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:04.510159 run patchelf(pid=8544): Launched 04:27:04.690561 run osmo-stp_10.42.42.5(pid=8541): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8541)] 04:27:04.825827 run osmo-stp_10.42.42.5(pid=8541): stdout: | (launched: 2022-12-14_04:27:03.382914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:04.963346 run osmo-stp_10.42.42.5(pid=8541): stderr: | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042703574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042703574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042703574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042703575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:05.100466 run osmo-stp_10.42.42.5(pid=8541): stdout: | (launched: 2022-12-14_04:27:03.382914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:05.231601 run osmo-stp_10.42.42.5(pid=8541): stderr: | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042703573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042703574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042703574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042703574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042703575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:05.386905 run patchelf(pid=8544): Terminating (SIGINT) 04:27:05.565803 run patchelf(pid=8544): Terminated: ok {rc=0} 04:27:05.695288 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8541): Process ended prematurely: osmo-stp_10.42.42.5(pid=8541) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8541)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 04:27:05.705075 tst ping.py:22: Test FAILED (6.7 sec) 04:27:05.733581 run osmo-hlr_10.42.42.2(pid=8538): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8538)] 04:27:05.784707 run osmo-hlr_10.42.42.2(pid=8538): stdout: | (launched: 2022-12-14_04:27:02.381272) 04:27:05.837398 run osmo-hlr_10.42.42.2(pid=8538): stderr: | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042702577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042702591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042702600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042702600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042702600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:05.890818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8537): Terminating (SIGTERM) 04:27:05.933134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8540): Terminating (SIGTERM) 04:27:05.976313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8543): Terminating (SIGTERM) 04:27:06.019445 --- ParallelTerminationStrategy: PID 8537 died... 04:27:06.040122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8537): Terminated: ok {rc=0} 04:27:06.087133 --- ParallelTerminationStrategy: PID 8540 died... 04:27:06.107240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8540): Terminated: ok {rc=0} 04:27:06.153960 --- ParallelTerminationStrategy: PID 8543 died... 04:27:06.174066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8543): Terminated: ok {rc=0} 04:27:06.263310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:27:07.349088 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.360713 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:27:07.431455 tst ping_idle_ping.py: using LAC 38539 04:27:07.549269 tst ping_idle_ping.py: using RAC 34 04:27:07.665520 tst ping_idle_ping.py: using CellId 38539 04:27:07.786476 tst ping_idle_ping.py: using BVCI 38540 04:27:07.895201 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.906203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.916879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.927578 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.938192 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.950123 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.961100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:27:07.971983 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:27:08.087147 tst ping_idle_ping.py:24: start network... 04:27:08.284918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:08.751534 run create_hlr_db(pid=8546): Launched 04:27:08.873776 bus /gobi_6: Setting Powered False 04:27:09.933525 run create_hlr_db(pid=8546): Terminated: ok {rc=0} 04:27:10.373267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Launched 04:27:10.696049 run osmo-hlr_10.42.42.2(pid=8549): Launched 04:27:10.819292 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:11.369985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Launched 04:27:11.691557 run osmo-stp_10.42.42.5(pid=8552): Launched 04:27:11.814943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:12.368419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8554): Launched 04:27:12.492354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:12.764595 run patchelf(pid=8555): Launched 04:27:12.944795 run osmo-stp_10.42.42.5(pid=8552): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] 04:27:13.080557 run osmo-stp_10.42.42.5(pid=8552): stdout: | (launched: 2022-12-14_04:27:11.632155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:13.218318 run osmo-stp_10.42.42.5(pid=8552): stderr: | [0;m[38;5;43m20221214042711824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042711824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042711825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042711825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:13.355891 run osmo-stp_10.42.42.5(pid=8552): stdout: | (launched: 2022-12-14_04:27:11.632155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:13.487317 run osmo-stp_10.42.42.5(pid=8552): stderr: | [0;m[38;5;43m20221214042711824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042711824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042711825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042711825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042711826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:13.642820 run patchelf(pid=8555): Terminating (SIGINT) 04:27:13.822216 run patchelf(pid=8555): Terminated: ok {rc=0} 04:27:13.951273 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8552): Process ended prematurely: osmo-stp_10.42.42.5(pid=8552) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:27:13.960684 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:27:13.989398 run osmo-hlr_10.42.42.2(pid=8549): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8549)] 04:27:14.040781 run osmo-hlr_10.42.42.2(pid=8549): stdout: | (launched: 2022-12-14_04:27:10.636650) 04:27:14.093953 run osmo-hlr_10.42.42.2(pid=8549): stderr: | [0;m[1;31m20221214042710833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042710833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042710833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042710834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042710834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042710834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042710867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042710876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042710877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042710877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:14.147141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Terminating (SIGTERM) 04:27:14.189403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Terminating (SIGTERM) 04:27:14.232299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8554): Terminating (SIGTERM) 04:27:14.275014 --- ParallelTerminationStrategy: PID 8548 died... 04:27:14.295453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Terminated: ok {rc=0} 04:27:14.342422 --- ParallelTerminationStrategy: PID 8551 died... 04:27:14.362508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Terminated: ok {rc=0} 04:27:14.409243 --- ParallelTerminationStrategy: PID 8554 died... 04:27:14.429170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8554): Terminated: ok {rc=0} 04:27:14.518644 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:27:15.825792 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:15.833471 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:27:15.878983 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:27:15.922749 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:27:15.982262 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:27:16.017892 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:27:16.066049 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:27:16.611024 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:27:16.617473 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:16.629721 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:27:16.705719 tst switch_tch_pdch.py: using LAC 38540 04:27:16.832706 tst switch_tch_pdch.py: using RAC 35 04:27:16.954330 tst switch_tch_pdch.py: using CellId 38540 04:27:17.105389 tst switch_tch_pdch.py: using BVCI 38541 04:27:17.224694 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.236907 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.248850 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.260749 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.273170 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.285389 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.297856 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:27:17.310127 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:27:17.432599 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:27:17.555759 tst switch_tch_pdch.py:51: start network... 04:27:17.753874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:18.212464 run create_hlr_db(pid=8560): Launched 04:27:18.333710 bus /gobi_6: Setting Powered False 04:27:19.393710 run create_hlr_db(pid=8560): Terminated: ok {rc=0} 04:27:19.829103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8562): Launched 04:27:20.147449 run osmo-hlr_10.42.42.2(pid=8563): Launched 04:27:20.268295 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:20.818073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Launched 04:27:21.138814 run osmo-stp_10.42.42.5(pid=8566): Launched 04:27:21.259602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:21.811866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8568): Launched 04:27:21.935111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:22.204014 run patchelf(pid=8569): Launched 04:27:22.382046 run osmo-stp_10.42.42.5(pid=8566): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] 04:27:22.516700 run osmo-stp_10.42.42.5(pid=8566): stdout: | (launched: 2022-12-14_04:27:21.078606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:22.653890 run osmo-stp_10.42.42.5(pid=8566): stderr: | [0;m[38;5;43m20221214042721268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042721269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042721269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042721269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:22.790750 run osmo-stp_10.42.42.5(pid=8566): stdout: | (launched: 2022-12-14_04:27:21.078606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:22.921132 run osmo-stp_10.42.42.5(pid=8566): stderr: | [0;m[38;5;43m20221214042721268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042721269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042721269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042721269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042721270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:23.075513 run patchelf(pid=8569): Terminating (SIGINT) 04:27:23.253573 run patchelf(pid=8569): Terminated: ok {rc=0} 04:27:23.381619 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8566): Process ended prematurely: osmo-stp_10.42.42.5(pid=8566) [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:27:23.391218 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:27:23.419337 run osmo-hlr_10.42.42.2(pid=8563): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8563)] 04:27:23.469936 run osmo-hlr_10.42.42.2(pid=8563): stdout: | (launched: 2022-12-14_04:27:20.088855) 04:27:23.522264 run osmo-hlr_10.42.42.2(pid=8563): stderr: | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042720284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042720296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042720304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042720304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042720304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:23.574324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8562): Terminating (SIGTERM) 04:27:23.616174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminating (SIGTERM) 04:27:23.659283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8568): Terminating (SIGTERM) 04:27:23.701659 --- ParallelTerminationStrategy: PID 8562 died... 04:27:23.721888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8562): Terminated: ok {rc=0} 04:27:23.768353 --- ParallelTerminationStrategy: PID 8565 died... 04:27:23.788181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminated: ok {rc=0} 04:27:23.834477 --- ParallelTerminationStrategy: PID 8568 died... 04:27:23.854310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8568): Terminated: ok {rc=0} 04:27:23.943172 bus /gobi_0: Setting Powered False 04:27:25.042304 bus /gobi_0: Setting Powered False 04:27:26.158007 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:27:27.411651 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:27.417982 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:27:27.451640 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:27:27.487397 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:27:27.542753 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:27:27.576633 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:27:27.612179 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:27:28.162867 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:27:28.168197 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.179329 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:27:28.248713 tst switch_tch_pdch.py: using LAC 38541 04:27:28.364778 tst switch_tch_pdch.py: using RAC 36 04:27:28.512627 tst switch_tch_pdch.py: using CellId 38541 04:27:28.629912 tst switch_tch_pdch.py: using BVCI 38542 04:27:28.736895 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.748439 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.759389 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.770303 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.781158 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.792149 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.803112 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:27:28.814079 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:27:28.933050 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:27:29.050988 tst switch_tch_pdch.py:51: start network... 04:27:29.265606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:29.731916 run create_hlr_db(pid=8574): Launched 04:27:29.853268 bus /gobi_6: Setting Powered False 04:27:30.929256 run create_hlr_db(pid=8574): Terminated: ok {rc=0} 04:27:31.356039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Launched 04:27:31.675860 run osmo-hlr_10.42.42.2(pid=8577): Launched 04:27:31.954181 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:32.558731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Launched 04:27:32.858256 run osmo-stp_10.42.42.5(pid=8580): Launched 04:27:32.970367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:27:33.457093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8582): Launched 04:27:33.571686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:27:33.822270 run patchelf(pid=8583): Launched 04:27:33.987288 run osmo-stp_10.42.42.5(pid=8580): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] 04:27:34.112753 run osmo-stp_10.42.42.5(pid=8580): stdout: | (launched: 2022-12-14_04:27:32.803032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:34.240297 run osmo-stp_10.42.42.5(pid=8580): stderr: | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042732973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:34.367663 run osmo-stp_10.42.42.5(pid=8580): stdout: | (launched: 2022-12-14_04:27:32.803032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:34.489177 run osmo-stp_10.42.42.5(pid=8580): stderr: | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042732972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042732973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042732973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:34.632744 run patchelf(pid=8583): Terminating (SIGINT) 04:27:34.799868 run patchelf(pid=8583): Terminated: ok {rc=0} 04:27:34.919968 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8580): Process ended prematurely: osmo-stp_10.42.42.5(pid=8580) [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:27:34.928892 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:27:34.955407 run osmo-hlr_10.42.42.2(pid=8577): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8577)] 04:27:35.003895 run osmo-hlr_10.42.42.2(pid=8577): stdout: | (launched: 2022-12-14_04:27:31.619390) 04:27:35.053429 run osmo-hlr_10.42.42.2(pid=8577): stderr: | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042731858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042731875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042731891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042731891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042731891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:35.103871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Terminating (SIGTERM) 04:27:35.143814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Terminating (SIGTERM) 04:27:35.183304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8582): Terminating (SIGTERM) 04:27:35.223331 --- ParallelTerminationStrategy: PID 8576 died... 04:27:35.242565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8576): Terminated: ok {rc=0} 04:27:35.286576 --- ParallelTerminationStrategy: PID 8579 died... 04:27:35.305427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8579): Terminated: ok {rc=0} 04:27:35.349085 --- ParallelTerminationStrategy: PID 8582 died... 04:27:35.367872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8582): Terminated: ok {rc=0} 04:27:35.453899 bus /gobi_0: Setting Powered False 04:27:36.552547 bus /gobi_0: Setting Powered False 04:27:37.668012 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:38.924005 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:38.928844 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:38.958104 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:27:38.965151 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:27:39.017091 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:39.046262 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:27:39.053264 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:27:39.591098 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:27:39.596231 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:27:39.607292 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:39.651510 tst mo_mt_sms.py: using LAC 38542 04:27:39.780898 tst mo_mt_sms.py: using RAC 37 04:27:39.905382 tst mo_mt_sms.py: using CellId 38542 04:27:40.028275 tst mo_mt_sms.py: using BVCI 38543 04:27:40.144071 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:40.259849 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:40.378246 tst mo_mt_sms.py:9: start nitb and bts... 04:27:40.594024 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:27:41.244556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8587): Launched 04:27:41.563823 run osmo-nitb_10.42.42.2(pid=8588): Launched 04:27:41.741683 run osmo-nitb_10.42.42.2(pid=8588): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8588)] 04:27:41.885146 run osmo-nitb_10.42.42.2(pid=8588): stdout: | (launched: 2022-12-14_04:27:41.505486) 04:27:42.030101 run osmo-nitb_10.42.42.2(pid=8588): stderr: | (launched: 2022-12-14_04:27:41.552820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:42.174935 run osmo-nitb_10.42.42.2(pid=8588): stdout: | (launched: 2022-12-14_04:27:41.505486) 04:27:42.313365 run osmo-nitb_10.42.42.2(pid=8588): stderr: | (launched: 2022-12-14_04:27:41.552820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8588) [trial-2399↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8588)] 04:27:42.685339 tst osmo-nitb_10.42.42.2(pid=8588): stdout: | (launched: 2022-12-14_04:27:41.505486) 04:27:42.813467 tst osmo-nitb_10.42.42.2(pid=8588): stderr: | (launched: 2022-12-14_04:27:41.552820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:27:42.964822 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8588) [trial-2399↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8588)] [trial-2399↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 04:27:42.974002 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 04:27:42.980937 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8587): Terminating (SIGTERM) 04:27:43.192022 --- ParallelTerminationStrategy: PID 8587 died... 04:27:43.213747 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8587): Terminated: ok {rc=0} 04:27:43.302036 bus /sierra_3: Setting Powered False 04:27:44.401832 bus /sierra_3: Setting Powered False 04:27:45.521761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:46.721189 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:46.733379 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:46.768026 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:27:46.798063 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:27:46.853996 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:46.891441 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:27:46.934484 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:27:47.456868 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 04:27:47.461812 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:47.472406 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:47.514391 tst mo_mt_sms.py: using LAC 38543 04:27:47.632483 tst mo_mt_sms.py: using RAC 38 04:27:47.748483 tst mo_mt_sms.py: using CellId 38543 04:27:47.864289 tst mo_mt_sms.py: using BVCI 38544 04:27:47.972881 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:47.983691 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:47.994264 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:48.004589 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:48.015085 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:27:48.025552 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:48.146149 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:27:48.265098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:27:48.761478 run create_hlr_db(pid=8592): Launched 04:27:48.885641 bus /sierra_2: Setting Powered False 04:27:49.949571 run create_hlr_db(pid=8592): Terminated: ok {rc=0} 04:27:50.375712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8594): Launched 04:27:50.672296 run osmo-hlr_10.42.42.2(pid=8595): Launched 04:27:50.787698 run osmo-stp_10.42.42.5: Starting osmo-stp 04:27:51.313229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8597): Launched 04:27:51.610271 run osmo-stp_10.42.42.5(pid=8598): Launched 04:27:51.725646 run osmo-msc_10.42.42.6: Starting osmo-msc 04:27:52.266238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8600): Launched 04:27:52.564106 run osmo-msc_10.42.42.6(pid=8601): Launched 04:27:52.730683 run osmo-stp_10.42.42.5(pid=8598): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8598)] 04:27:52.856250 run osmo-stp_10.42.42.5(pid=8598): stdout: | (launched: 2022-12-14_04:27:51.554885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:52.981724 run osmo-stp_10.42.42.5(pid=8598): stderr: | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042751725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:53.104782 run osmo-stp_10.42.42.5(pid=8598): stdout: | (launched: 2022-12-14_04:27:51.554885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:27:53.222237 run osmo-stp_10.42.42.5(pid=8598): stderr: | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042751724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042751725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042751725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:27:53.363517 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8598): Process ended prematurely: osmo-stp_10.42.42.5(pid=8598) [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8598)] [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 04:27:53.371808 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 04:27:53.397899 run osmo-hlr_10.42.42.2(pid=8595): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8595)] 04:27:53.449980 run osmo-hlr_10.42.42.2(pid=8595): stdout: | (launched: 2022-12-14_04:27:50.616850) 04:27:53.501960 run osmo-hlr_10.42.42.2(pid=8595): stderr: | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042750794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042750806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:27:53.577895 run osmo-msc_10.42.42.6(pid=8601): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8601)] 04:27:53.627313 run osmo-msc_10.42.42.6(pid=8601): stdout: | (launched: 2022-12-14_04:27:52.508839) 04:27:53.677073 run osmo-msc_10.42.42.6(pid=8601): stderr: | [0;m[38;5;43m20221214042752781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042752782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa983673c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042752782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042752782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042752782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042752782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042752784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042752784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042752784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042752784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:27:53.726913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8594): Terminating (SIGTERM) 04:27:53.766342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8597): Terminating (SIGTERM) 04:27:53.805693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8600): Terminating (SIGTERM) 04:27:53.845585 --- ParallelTerminationStrategy: PID 8594 died... 04:27:53.864647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8594): Terminated: ok {rc=0} 04:27:53.908394 --- ParallelTerminationStrategy: PID 8597 died... 04:27:53.927047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8597): Terminated: ok {rc=0} 04:27:53.970703 --- ParallelTerminationStrategy: PID 8600 died... 04:27:53.989454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8600): Terminated: ok {rc=0} 04:27:54.073220 bus /sierra_3: Setting Powered False 04:27:55.169013 bus /sierra_3: Setting Powered False 04:27:56.284501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:27:57.513102 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:27:57.517011 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:27:57.545776 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 04:27:57.552629 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:27:57.587792 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:27:57.617154 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 04:27:57.623881 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:27:58.148742 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:27:58.155314 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 04:27:58.166601 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:27:58.210096 tst assert_extension.py: using LAC 38544 04:27:58.327577 tst assert_extension.py: using RAC 39 04:27:58.443122 tst assert_extension.py: using CellId 38544 04:27:58.562038 tst assert_extension.py: using BVCI 38545 04:27:58.670387 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:27:58.788081 tst assert_extension.py:10: start nitb and bts... 04:27:59.002669 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:27:59.655618 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8606): Launched 04:27:59.976830 run osmo-nitb_10.42.42.2(pid=8607): Launched 04:28:00.154817 run osmo-nitb_10.42.42.2(pid=8607): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8607)] 04:28:00.298113 run osmo-nitb_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-14_04:27:59.918362) 04:28:00.442937 run osmo-nitb_10.42.42.2(pid=8607): stderr: | (launched: 2022-12-14_04:27:59.965559) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:28:00.587563 run osmo-nitb_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-14_04:27:59.918362) 04:28:00.726702 run osmo-nitb_10.42.42.2(pid=8607): stderr: | (launched: 2022-12-14_04:27:59.965559) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8607) [trial-2399↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8607)] 04:28:01.098180 tst osmo-nitb_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-14_04:27:59.918362) 04:28:01.228396 tst osmo-nitb_10.42.42.2(pid=8607): stderr: | (launched: 2022-12-14_04:27:59.965559) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:28:01.384311 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8607) [trial-2399↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8607)] [trial-2399↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 04:28:01.394063 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:28:01.401903 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8606): Terminating (SIGTERM) 04:28:01.614843 --- ParallelTerminationStrategy: PID 8606 died... 04:28:01.647091 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8606): Terminated: ok {rc=0} 04:28:01.760327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 04:28:02.947567 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:02.951953 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:28:02.982091 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:28:03.011794 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 04:28:03.049235 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:28:03.079923 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:28:03.108202 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 04:28:03.636469 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 04:28:03.642057 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:03.653409 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:28:03.700401 tst assert_extension.py: using LAC 38545 04:28:03.825359 tst assert_extension.py: using RAC 40 04:28:03.950303 tst assert_extension.py: using CellId 38545 04:28:04.075885 tst assert_extension.py: using BVCI 38546 04:28:04.192442 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:04.203929 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:04.215214 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:04.226452 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:04.238624 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:28:04.250739 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 04:28:04.367807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:04.828128 run create_hlr_db(pid=8612): Launched 04:28:04.950041 bus /sierra_2: Setting Powered False 04:28:06.009798 run create_hlr_db(pid=8612): Terminated: ok {rc=0} 04:28:06.424568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8614): Launched 04:28:06.721940 run osmo-hlr_10.42.42.2(pid=8615): Launched 04:28:06.834408 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:07.348708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8617): Launched 04:28:07.646824 run osmo-stp_10.42.42.5(pid=8618): Launched 04:28:07.764701 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:08.301220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8620): Launched 04:28:08.599789 run osmo-msc_10.42.42.6(pid=8621): Launched 04:28:08.768153 run osmo-stp_10.42.42.5(pid=8618): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8618)] 04:28:08.893981 run osmo-stp_10.42.42.5(pid=8618): stdout: | (launched: 2022-12-14_04:28:07.591241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:09.019701 run osmo-stp_10.42.42.5(pid=8618): stderr: | [0;m[38;5;43m20221214042807759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042807760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042807760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042807760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:09.144127 run osmo-stp_10.42.42.5(pid=8618): stdout: | (launched: 2022-12-14_04:28:07.591241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:09.262344 run osmo-stp_10.42.42.5(pid=8618): stderr: | [0;m[38;5;43m20221214042807759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042807760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042807760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042807760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042807761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:09.404807 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8618): Process ended prematurely: osmo-stp_10.42.42.5(pid=8618) [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8618)] [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 04:28:09.413383 tst assert_extension.py:17: Test FAILED (5.8 sec) 04:28:09.439531 run osmo-hlr_10.42.42.2(pid=8615): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8615)] 04:28:09.487856 run osmo-hlr_10.42.42.2(pid=8615): stdout: | (launched: 2022-12-14_04:28:06.666509) 04:28:09.537471 run osmo-hlr_10.42.42.2(pid=8615): stderr: | [0;m[1;31m20221214042806841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042806841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042806841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042806841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042806842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042806842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042806854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042806862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042806863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042806863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:09.606847 run osmo-msc_10.42.42.6(pid=8621): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8621)] 04:28:09.654523 run osmo-msc_10.42.42.6(pid=8621): stdout: | (launched: 2022-12-14_04:28:08.544404) 04:28:09.703913 run osmo-msc_10.42.42.6(pid=8621): stderr: | [0;m[38;5;43m20221214042808814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042808814 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61092b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042808814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042808814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042808814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042808815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042808816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042808817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042808817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042808817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:09.753740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8614): Terminating (SIGTERM) 04:28:09.793153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8617): Terminating (SIGTERM) 04:28:09.832851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8620): Terminating (SIGTERM) 04:28:09.872562 --- ParallelTerminationStrategy: PID 8614 died... 04:28:09.891853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8614): Terminated: ok {rc=0} 04:28:09.935717 --- ParallelTerminationStrategy: PID 8617 died... 04:28:09.954337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8617): Terminated: ok {rc=0} 04:28:09.997946 --- ParallelTerminationStrategy: PID 8620 died... 04:28:10.016470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8620): Terminated: ok {rc=0} 04:28:10.100720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:28:11.310817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:11.318105 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:28:11.348186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:28:11.376608 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:28:11.429014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:28:11.458844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:28:11.486507 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:28:12.041027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:28:12.094766 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.106768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:28:12.174353 tst mo_mt_call.py: using LAC 38546 04:28:12.302558 tst mo_mt_call.py: using RAC 41 04:28:12.429729 tst mo_mt_call.py: using CellId 38546 04:28:12.557136 tst mo_mt_call.py: using BVCI 38547 04:28:12.677822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.689889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.701714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.713466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.725703 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:12.737904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:12.855129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:12.976693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:13.483064 run create_hlr_db(pid=8626): Launched 04:28:13.608686 bus /sierra_2: Setting Powered False 04:28:14.674183 run create_hlr_db(pid=8626): Terminated: ok {rc=0} 04:28:15.127192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8628): Launched 04:28:15.455377 run osmo-hlr_10.42.42.2(pid=8629): Launched 04:28:15.581825 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:16.158874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8631): Launched 04:28:16.500198 run osmo-stp_10.42.42.5(pid=8632): Launched 04:28:16.731242 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:17.391644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8634): Launched 04:28:17.710604 run osmo-msc_10.42.42.6(pid=8635): Launched 04:28:17.882277 run osmo-stp_10.42.42.5(pid=8632): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8632)] 04:28:18.010622 run osmo-stp_10.42.42.5(pid=8632): stdout: | (launched: 2022-12-14_04:28:16.437759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:18.138424 run osmo-stp_10.42.42.5(pid=8632): stderr: | [0;m[38;5;43m20221214042816739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042816739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042816740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042816741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042816741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042816742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042816742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:18.264560 run osmo-stp_10.42.42.5(pid=8632): stdout: | (launched: 2022-12-14_04:28:16.437759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:18.384396 run osmo-stp_10.42.42.5(pid=8632): stderr: | [0;m[38;5;43m20221214042816739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042816739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042816740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042816741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042816741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042816742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042816742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:18.528065 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8632): Process ended prematurely: osmo-stp_10.42.42.5(pid=8632) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8632)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:28:18.536888 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 04:28:18.563325 run osmo-hlr_10.42.42.2(pid=8629): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8629)] 04:28:18.610983 run osmo-hlr_10.42.42.2(pid=8629): stdout: | (launched: 2022-12-14_04:28:15.394996) 04:28:18.659829 run osmo-hlr_10.42.42.2(pid=8629): stderr: | [0;m[1;31m20221214042815591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042815591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042815591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042815592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042815592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042815592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042815604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042815612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042815612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042815612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:18.728397 run osmo-msc_10.42.42.6(pid=8635): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8635)] 04:28:18.775323 run osmo-msc_10.42.42.6(pid=8635): stdout: | (launched: 2022-12-14_04:28:17.654129) 04:28:18.824266 run osmo-msc_10.42.42.6(pid=8635): stderr: | [0;m[38;5;43m20221214042817922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042817922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb445007c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042817922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042817922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042817922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042817923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042817924 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042817925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042817925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042817925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:18.873377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8628): Terminating (SIGTERM) 04:28:18.912570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8631): Terminating (SIGTERM) 04:28:18.951917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8634): Terminating (SIGTERM) 04:28:18.991648 --- ParallelTerminationStrategy: PID 8628 died... 04:28:19.010876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8628): Terminated: ok {rc=0} 04:28:19.054442 --- ParallelTerminationStrategy: PID 8631 died... 04:28:19.072800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8631): Terminated: ok {rc=0} 04:28:19.116380 --- ParallelTerminationStrategy: PID 8634 died... 04:28:19.135063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8634): Terminated: ok {rc=0} 04:28:19.219925 bus /sierra_3: Setting Powered False 04:28:20.319384 bus /sierra_3: Setting Powered False 04:28:21.433694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:28:22.577381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:22.589616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:28:22.659359 tst mo_mt_call_osmux.py: using LAC 38547 04:28:22.778398 tst mo_mt_call_osmux.py: using RAC 42 04:28:22.897164 tst mo_mt_call_osmux.py: using CellId 38547 04:28:23.014143 tst mo_mt_call_osmux.py: using BVCI 38548 04:28:23.124922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:23.136342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:23.147732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:23.159093 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:23.170570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:28:23.181939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:23.303515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:28:23.423137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:23.894441 run create_hlr_db(pid=8637): Launched 04:28:24.019730 bus /sierra_2: Setting Powered False 04:28:25.081306 run create_hlr_db(pid=8637): Terminated: ok {rc=0} 04:28:25.527080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Launched 04:28:25.855632 run osmo-hlr_10.42.42.2(pid=8640): Launched 04:28:25.981502 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:26.546820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Launched 04:28:26.873331 run osmo-stp_10.42.42.5(pid=8643): Launched 04:28:26.999292 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:27.594582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Launched 04:28:27.922332 run osmo-msc_10.42.42.6(pid=8646): Launched 04:28:28.103516 run osmo-stp_10.42.42.5(pid=8643): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] 04:28:28.241958 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-14_04:28:26.813296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:28.380265 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042827004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:28.516853 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-14_04:28:26.813296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:28.646711 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042827003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042827004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042827004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:28.802445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:28:28.812164 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:28:28.840405 run osmo-hlr_10.42.42.2(pid=8640): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8640)] 04:28:28.891755 run osmo-hlr_10.42.42.2(pid=8640): stdout: | (launched: 2022-12-14_04:28:25.795561) 04:28:28.944725 run osmo-hlr_10.42.42.2(pid=8640): stderr: | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042825992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042826005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042826013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042826013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042826014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:29.018606 run osmo-msc_10.42.42.6(pid=8646): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8646)] 04:28:29.069252 run osmo-msc_10.42.42.6(pid=8646): stdout: | (launched: 2022-12-14_04:28:27.861528) 04:28:29.122351 run osmo-msc_10.42.42.6(pid=8646): stderr: | [0;m[38;5;43m20221214042828183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042828183 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff2ad38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042828183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042828183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042828183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042828183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042828185 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042828186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042828186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042828186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:29.175885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminating (SIGTERM) 04:28:29.218230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminating (SIGTERM) 04:28:29.260932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Terminating (SIGTERM) 04:28:29.304057 --- ParallelTerminationStrategy: PID 8639 died... 04:28:29.324637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminated: ok {rc=0} 04:28:29.372235 --- ParallelTerminationStrategy: PID 8642 died... 04:28:29.392358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminated: ok {rc=0} 04:28:29.439434 --- ParallelTerminationStrategy: PID 8645 died... 04:28:29.459613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8645): Terminated: ok {rc=0} 04:28:29.548848 bus /sierra_3: Setting Powered False 04:28:30.646764 bus /sierra_3: Setting Powered False 04:28:31.762192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:28:33.016267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:33.022622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:28:33.051344 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:28:33.077991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:28:33.129635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:28:33.159017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:28:33.185975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:28:33.738099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:28:33.787289 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:33.798645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:28:33.864745 tst mo_mt_call.py: using LAC 38548 04:28:33.983645 tst mo_mt_call.py: using RAC 43 04:28:34.111578 tst mo_mt_call.py: using CellId 38548 04:28:34.238942 tst mo_mt_call.py: using BVCI 38549 04:28:34.357306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:34.369032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:34.380859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:34.392440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:34.404539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:34.416392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:34.533869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:34.654409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:35.160199 run create_hlr_db(pid=8651): Launched 04:28:35.283733 bus /sierra_2: Setting Powered False 04:28:36.348675 run create_hlr_db(pid=8651): Terminated: ok {rc=0} 04:28:36.783545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Launched 04:28:37.087677 run osmo-hlr_10.42.42.2(pid=8654): Launched 04:28:37.202996 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:37.727551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Launched 04:28:38.032741 run osmo-stp_10.42.42.5(pid=8657): Launched 04:28:38.148884 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:38.697960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Launched 04:28:39.001600 run osmo-msc_10.42.42.6(pid=8660): Launched 04:28:39.172160 run osmo-stp_10.42.42.5(pid=8657): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] 04:28:39.300774 run osmo-stp_10.42.42.5(pid=8657): stdout: | (launched: 2022-12-14_04:28:37.976084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:39.429727 run osmo-stp_10.42.42.5(pid=8657): stderr: | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042838147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:39.556129 run osmo-stp_10.42.42.5(pid=8657): stdout: | (launched: 2022-12-14_04:28:37.976084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:39.678066 run osmo-stp_10.42.42.5(pid=8657): stderr: | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042838146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042838147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042838147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:39.822492 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8657): Process ended prematurely: osmo-stp_10.42.42.5(pid=8657) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:28:39.831243 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:28:39.857781 run osmo-hlr_10.42.42.2(pid=8654): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8654)] 04:28:39.905341 run osmo-hlr_10.42.42.2(pid=8654): stdout: | (launched: 2022-12-14_04:28:37.030938) 04:28:39.954586 run osmo-hlr_10.42.42.2(pid=8654): stderr: | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042837204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042837219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042837230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042837230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042837230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:40.023644 run osmo-msc_10.42.42.6(pid=8660): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8660)] 04:28:40.071720 run osmo-msc_10.42.42.6(pid=8660): stdout: | (launched: 2022-12-14_04:28:38.944868) 04:28:40.121487 run osmo-msc_10.42.42.6(pid=8660): stderr: | [0;m[38;5;43m20221214042839215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042839216 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc91696bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042839216 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042839216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042839216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042839216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042839218 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042839218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042839218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042839219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:40.171125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Terminating (SIGTERM) 04:28:40.210804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Terminating (SIGTERM) 04:28:40.250300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Terminating (SIGTERM) 04:28:40.290253 --- ParallelTerminationStrategy: PID 8653 died... 04:28:40.309431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8653): Terminated: ok {rc=0} 04:28:40.353423 --- ParallelTerminationStrategy: PID 8656 died... 04:28:40.371942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8656): Terminated: ok {rc=0} 04:28:40.415981 --- ParallelTerminationStrategy: PID 8659 died... 04:28:40.434823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8659): Terminated: ok {rc=0} 04:28:40.520311 bus /sierra_3: Setting Powered False 04:28:41.619889 bus /sierra_3: Setting Powered False 04:28:42.735850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:28:43.881143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:43.893159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:28:43.958398 tst mo_mt_call_osmux.py: using LAC 38549 04:28:44.077535 tst mo_mt_call_osmux.py: using RAC 44 04:28:44.207721 tst mo_mt_call_osmux.py: using CellId 38549 04:28:44.336578 tst mo_mt_call_osmux.py: using BVCI 38550 04:28:44.455131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:44.467025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:44.478604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:44.490149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:44.502181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:28:44.513881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:44.635292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:28:44.753492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:45.224889 run create_hlr_db(pid=8662): Launched 04:28:45.350382 bus /sierra_2: Setting Powered False 04:28:46.409593 run create_hlr_db(pid=8662): Terminated: ok {rc=0} 04:28:46.843389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8664): Launched 04:28:47.168013 run osmo-hlr_10.42.42.2(pid=8665): Launched 04:28:47.292843 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:47.835637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Launched 04:28:48.139085 run osmo-stp_10.42.42.5(pid=8668): Launched 04:28:48.254226 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:48.820658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8670): Launched 04:28:49.123837 run osmo-msc_10.42.42.6(pid=8671): Launched 04:28:49.292495 run osmo-stp_10.42.42.5(pid=8668): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] 04:28:49.420582 run osmo-stp_10.42.42.5(pid=8668): stdout: | (launched: 2022-12-14_04:28:48.082523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:49.547845 run osmo-stp_10.42.42.5(pid=8668): stderr: | [0;m[38;5;43m20221214042848253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042848254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042848254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042848254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:49.673508 run osmo-stp_10.42.42.5(pid=8668): stdout: | (launched: 2022-12-14_04:28:48.082523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:28:49.793711 run osmo-stp_10.42.42.5(pid=8668): stderr: | [0;m[38;5;43m20221214042848253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042848254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042848254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042848254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042848255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:28:49.937293 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8668): Process ended prematurely: osmo-stp_10.42.42.5(pid=8668) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:28:49.946146 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:28:49.972542 run osmo-hlr_10.42.42.2(pid=8665): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8665)] 04:28:50.020927 run osmo-hlr_10.42.42.2(pid=8665): stdout: | (launched: 2022-12-14_04:28:47.108492) 04:28:50.070203 run osmo-hlr_10.42.42.2(pid=8665): stderr: | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042847299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042847312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042847322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042847322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042847322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:28:50.139239 run osmo-msc_10.42.42.6(pid=8671): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8671)] 04:28:50.186854 run osmo-msc_10.42.42.6(pid=8671): stdout: | (launched: 2022-12-14_04:28:49.067199) 04:28:50.235866 run osmo-msc_10.42.42.6(pid=8671): stderr: | [0;m[38;5;43m20221214042849339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042849339 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa73b057c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042849339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042849339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042849339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042849339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042849341 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042849342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042849342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042849342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:28:50.285484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8664): Terminating (SIGTERM) 04:28:50.324858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Terminating (SIGTERM) 04:28:50.364820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8670): Terminating (SIGTERM) 04:28:50.404356 --- ParallelTerminationStrategy: PID 8664 died... 04:28:50.423484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8664): Terminated: ok {rc=0} 04:28:50.467262 --- ParallelTerminationStrategy: PID 8667 died... 04:28:50.485963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8667): Terminated: ok {rc=0} 04:28:50.529462 --- ParallelTerminationStrategy: PID 8670 died... 04:28:50.548189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8670): Terminated: ok {rc=0} 04:28:50.634203 bus /sierra_3: Setting Powered False 04:28:51.735876 bus /sierra_3: Setting Powered False 04:28:52.853437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:28:54.104132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:28:54.111214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:28:54.141328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:28:54.169548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:28:54.223917 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:28:54.254221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:28:54.282412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:28:54.832785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:28:54.887821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:54.900172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:28:54.966847 tst mo_mt_call.py: using LAC 38550 04:28:55.094316 tst mo_mt_call.py: using RAC 45 04:28:55.226806 tst mo_mt_call.py: using CellId 38550 04:28:55.354537 tst mo_mt_call.py: using BVCI 38551 04:28:55.473504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:55.485219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:55.496666 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:55.508183 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:55.520219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:28:55.532217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:28:55.649662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:28:55.770139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:28:56.276374 run create_hlr_db(pid=8676): Launched 04:28:56.402090 bus /sierra_2: Setting Powered False 04:28:57.467483 run create_hlr_db(pid=8676): Terminated: ok {rc=0} 04:28:57.904507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8678): Launched 04:28:58.233104 run osmo-hlr_10.42.42.2(pid=8679): Launched 04:28:58.356862 run osmo-stp_10.42.42.5: Starting osmo-stp 04:28:58.922218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8681): Launched 04:28:59.250373 run osmo-stp_10.42.42.5(pid=8682): Launched 04:28:59.376421 run osmo-msc_10.42.42.6: Starting osmo-msc 04:28:59.970484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8684): Launched 04:29:00.298370 run osmo-msc_10.42.42.6(pid=8685): Launched 04:29:00.483075 run osmo-stp_10.42.42.5(pid=8682): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8682)] 04:29:00.624700 run osmo-stp_10.42.42.5(pid=8682): stdout: | (launched: 2022-12-14_04:28:59.190195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:00.761184 run osmo-stp_10.42.42.5(pid=8682): stderr: | [0;m[38;5;43m20221214042859382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042859382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042859383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042859383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:00.914331 run osmo-stp_10.42.42.5(pid=8682): stdout: | (launched: 2022-12-14_04:28:59.190195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:01.041775 run osmo-stp_10.42.42.5(pid=8682): stderr: | [0;m[38;5;43m20221214042859382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042859382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042859383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042859383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042859384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:01.193563 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8682): Process ended prematurely: osmo-stp_10.42.42.5(pid=8682) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8682)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:29:01.203148 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:29:01.231731 run osmo-hlr_10.42.42.2(pid=8679): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8679)] 04:29:01.282121 run osmo-hlr_10.42.42.2(pid=8679): stdout: | (launched: 2022-12-14_04:28:58.172634) 04:29:01.333736 run osmo-hlr_10.42.42.2(pid=8679): stderr: | [0;m[1;31m20221214042858370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042858370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042858370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042858371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042858371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042858371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042858383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042858391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042858391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042858391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:01.407300 run osmo-msc_10.42.42.6(pid=8685): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8685)] 04:29:01.457470 run osmo-msc_10.42.42.6(pid=8685): stdout: | (launched: 2022-12-14_04:29:00.237958) 04:29:01.509046 run osmo-msc_10.42.42.6(pid=8685): stderr: | [0;m[38;5;43m20221214042900558 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042900558 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2cea4f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042900558 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042900558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042900559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042900559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042900560 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042900561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042900561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042900561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:01.561971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8678): Terminating (SIGTERM) 04:29:01.605142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8681): Terminating (SIGTERM) 04:29:01.647244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8684): Terminating (SIGTERM) 04:29:01.692457 --- ParallelTerminationStrategy: PID 8678 died... 04:29:01.713366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8678): Terminated: ok {rc=0} 04:29:01.761319 --- ParallelTerminationStrategy: PID 8681 died... 04:29:01.783747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8681): Terminated: ok {rc=0} 04:29:01.829731 --- ParallelTerminationStrategy: PID 8684 died... 04:29:01.850118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8684): Terminated: ok {rc=0} 04:29:01.943794 bus /sierra_3: Setting Powered False 04:29:03.058092 bus /sierra_3: Setting Powered False 04:29:04.177915 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:29:05.324651 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.336682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:29:05.402616 tst mo_mt_call_osmux.py: using LAC 38551 04:29:05.520934 tst mo_mt_call_osmux.py: using RAC 46 04:29:05.639551 tst mo_mt_call_osmux.py: using CellId 38551 04:29:05.763740 tst mo_mt_call_osmux.py: using BVCI 38552 04:29:05.874398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.885781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.896997 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.908082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.919262 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:29:05.930374 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:06.052253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:29:06.170502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:06.642818 run create_hlr_db(pid=8687): Launched 04:29:06.768745 bus /sierra_2: Setting Powered False 04:29:07.830162 run create_hlr_db(pid=8687): Terminated: ok {rc=0} 04:29:08.274524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8689): Launched 04:29:08.602972 run osmo-hlr_10.42.42.2(pid=8690): Launched 04:29:08.730216 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:09.258214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8692): Launched 04:29:09.562228 run osmo-stp_10.42.42.5(pid=8693): Launched 04:29:09.680227 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:10.231070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8695): Launched 04:29:10.534687 run osmo-msc_10.42.42.6(pid=8696): Launched 04:29:10.704774 run osmo-stp_10.42.42.5(pid=8693): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8693)] 04:29:10.833869 run osmo-stp_10.42.42.5(pid=8693): stdout: | (launched: 2022-12-14_04:29:09.505655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:10.961930 run osmo-stp_10.42.42.5(pid=8693): stderr: | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042909676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:11.087958 run osmo-stp_10.42.42.5(pid=8693): stdout: | (launched: 2022-12-14_04:29:09.505655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:11.207928 run osmo-stp_10.42.42.5(pid=8693): stderr: | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042909675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042909676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042909676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:11.351986 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8693): Process ended prematurely: osmo-stp_10.42.42.5(pid=8693) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8693)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:29:11.360844 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 04:29:11.387474 run osmo-hlr_10.42.42.2(pid=8690): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8690)] 04:29:11.435057 run osmo-hlr_10.42.42.2(pid=8690): stdout: | (launched: 2022-12-14_04:29:08.542650) 04:29:11.484281 run osmo-hlr_10.42.42.2(pid=8690): stderr: | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042908739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042908751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042908760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042908760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042908760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:11.553267 run osmo-msc_10.42.42.6(pid=8696): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8696)] 04:29:11.600906 run osmo-msc_10.42.42.6(pid=8696): stdout: | (launched: 2022-12-14_04:29:10.478208) 04:29:11.650082 run osmo-msc_10.42.42.6(pid=8696): stderr: | [0;m[38;5;43m20221214042910748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042910748 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7cac7b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042910748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042910748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042910748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042910749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042910750 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042910751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042910751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042910751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:11.699557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8689): Terminating (SIGTERM) 04:29:11.739286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8692): Terminating (SIGTERM) 04:29:11.778918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8695): Terminating (SIGTERM) 04:29:11.818872 --- ParallelTerminationStrategy: PID 8689 died... 04:29:11.838017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8689): Terminated: ok {rc=0} 04:29:11.882562 --- ParallelTerminationStrategy: PID 8692 died... 04:29:11.901735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8692): Terminated: ok {rc=0} 04:29:11.946395 --- ParallelTerminationStrategy: PID 8695 died... 04:29:11.965258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8695): Terminated: ok {rc=0} 04:29:12.049358 bus /sierra_3: Setting Powered False 04:29:13.146906 bus /sierra_3: Setting Powered False 04:29:14.265463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 04:29:15.514539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:15.522277 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 04:29:15.551686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 04:29:15.578460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 04:29:15.637984 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 04:29:15.670323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 04:29:15.698395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 04:29:16.249609 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 04:29:16.299801 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:16.311908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:29:16.376928 tst mo_mt_call.py: using LAC 38552 04:29:16.509881 tst mo_mt_call.py: using RAC 47 04:29:16.676141 tst mo_mt_call.py: using CellId 38552 04:29:16.809173 tst mo_mt_call.py: using BVCI 38553 04:29:16.945859 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:16.958953 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:16.971616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:16.985455 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:16.999346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:17.014311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:17.140157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:17.267973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:17.778881 run create_hlr_db(pid=8701): Launched 04:29:17.904180 bus /sierra_2: Setting Powered False 04:29:18.969304 run create_hlr_db(pid=8701): Terminated: ok {rc=0} 04:29:19.405311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8703): Launched 04:29:19.710088 run osmo-hlr_10.42.42.2(pid=8704): Launched 04:29:19.827852 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:20.367846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8706): Launched 04:29:20.671475 run osmo-stp_10.42.42.5(pid=8707): Launched 04:29:20.789455 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:21.339857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8709): Launched 04:29:21.647380 run osmo-msc_10.42.42.6(pid=8710): Launched 04:29:21.819320 run osmo-stp_10.42.42.5(pid=8707): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8707)] 04:29:21.949163 run osmo-stp_10.42.42.5(pid=8707): stdout: | (launched: 2022-12-14_04:29:20.615093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:22.078804 run osmo-stp_10.42.42.5(pid=8707): stderr: | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042920789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:22.205604 run osmo-stp_10.42.42.5(pid=8707): stdout: | (launched: 2022-12-14_04:29:20.615093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:22.326494 run osmo-stp_10.42.42.5(pid=8707): stderr: | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042920788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042920789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042920789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:22.471001 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8707): Process ended prematurely: osmo-stp_10.42.42.5(pid=8707) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8707)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 04:29:22.480161 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:29:22.506925 run osmo-hlr_10.42.42.2(pid=8704): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8704)] 04:29:22.555035 run osmo-hlr_10.42.42.2(pid=8704): stdout: | (launched: 2022-12-14_04:29:19.653329) 04:29:22.604470 run osmo-hlr_10.42.42.2(pid=8704): stderr: | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042919830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042919842 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042919850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042919850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042919850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:22.673592 run osmo-msc_10.42.42.6(pid=8710): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8710)] 04:29:22.721054 run osmo-msc_10.42.42.6(pid=8710): stdout: | (launched: 2022-12-14_04:29:21.590616) 04:29:22.770156 run osmo-msc_10.42.42.6(pid=8710): stderr: | [0;m[38;5;43m20221214042921862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042921862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8926559c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042921862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042921862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042921863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042921863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042921864 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042921865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042921865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042921865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:22.819700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8703): Terminating (SIGTERM) 04:29:22.859619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8706): Terminating (SIGTERM) 04:29:22.899540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8709): Terminating (SIGTERM) 04:29:22.939622 --- ParallelTerminationStrategy: PID 8703 died... 04:29:22.958845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8703): Terminated: ok {rc=0} 04:29:23.002723 --- ParallelTerminationStrategy: PID 8706 died... 04:29:23.021658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8706): Terminated: ok {rc=0} 04:29:23.065762 --- ParallelTerminationStrategy: PID 8709 died... 04:29:23.084457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8709): Terminated: ok {rc=0} 04:29:23.170319 bus /sierra_3: Setting Powered False 04:29:24.270278 bus /sierra_3: Setting Powered False 04:29:25.386752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 04:29:26.535392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:26.547582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 04:29:26.613665 tst mo_mt_call_osmux.py: using LAC 38553 04:29:26.734821 tst mo_mt_call_osmux.py: using RAC 48 04:29:26.856355 tst mo_mt_call_osmux.py: using CellId 38553 04:29:26.977480 tst mo_mt_call_osmux.py: using BVCI 38554 04:29:27.087254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:27.098672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:27.109869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:27.121069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:27.132276 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 04:29:27.143466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:27.259624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 04:29:27.380771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:27.887785 run create_hlr_db(pid=8712): Launched 04:29:28.014268 bus /sierra_2: Setting Powered False 04:29:29.078851 run create_hlr_db(pid=8712): Terminated: ok {rc=0} 04:29:29.513140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8714): Launched 04:29:29.816682 run osmo-hlr_10.42.42.2(pid=8715): Launched 04:29:29.932220 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:30.462265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8717): Launched 04:29:30.764941 run osmo-stp_10.42.42.5(pid=8718): Launched 04:29:30.910636 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:31.605361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8720): Launched 04:29:31.953199 run osmo-msc_10.42.42.6(pid=8721): Launched 04:29:32.332587 run osmo-stp_10.42.42.5(pid=8718): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8718)] 04:29:32.458693 run osmo-stp_10.42.42.5(pid=8718): stdout: | (launched: 2022-12-14_04:29:30.708466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:32.584816 run osmo-stp_10.42.42.5(pid=8718): stderr: | [0;m[38;5;43m20221214042930947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042930947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042930948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042930948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:32.711188 run osmo-stp_10.42.42.5(pid=8718): stdout: | (launched: 2022-12-14_04:29:30.708466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:32.831520 run osmo-stp_10.42.42.5(pid=8718): stderr: | [0;m[38;5;43m20221214042930947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042930947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042930948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042930948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042930949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:32.975568 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8718): Process ended prematurely: osmo-stp_10.42.42.5(pid=8718) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8718)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 04:29:32.984572 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 04:29:33.011273 run osmo-hlr_10.42.42.2(pid=8715): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8715)] 04:29:33.059591 run osmo-hlr_10.42.42.2(pid=8715): stdout: | (launched: 2022-12-14_04:29:29.759995) 04:29:33.109457 run osmo-hlr_10.42.42.2(pid=8715): stderr: | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042929934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042929946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042929954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042929955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042929955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:33.179136 run osmo-msc_10.42.42.6(pid=8721): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8721)] 04:29:33.226840 run osmo-msc_10.42.42.6(pid=8721): stdout: | (launched: 2022-12-14_04:29:31.892292) 04:29:33.276180 run osmo-msc_10.42.42.6(pid=8721): stderr: | [0;m[38;5;43m20221214042932238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042932238 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b7338ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042932238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042932238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042932238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042932238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042932240 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042932240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042932241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042932241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:33.326140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8714): Terminating (SIGTERM) 04:29:33.365684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8717): Terminating (SIGTERM) 04:29:33.405212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8720): Terminating (SIGTERM) 04:29:33.445177 --- ParallelTerminationStrategy: PID 8714 died... 04:29:33.464534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8714): Terminated: ok {rc=0} 04:29:33.508794 --- ParallelTerminationStrategy: PID 8717 died... 04:29:33.528163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8717): Terminated: ok {rc=0} 04:29:33.572136 --- ParallelTerminationStrategy: PID 8720 died... 04:29:33.591065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8720): Terminated: ok {rc=0} 04:29:33.676526 bus /sierra_3: Setting Powered False 04:29:34.776372 bus /sierra_3: Setting Powered False 04:29:35.891304 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:29:37.135137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:37.141652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:29:37.170264 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:29:37.197049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:29:37.247490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:29:37.276137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:29:37.302327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:29:37.862081 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:29:37.910367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:37.921572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:29:37.985251 tst mo_mt_call.py: using LAC 38554 04:29:38.113875 tst mo_mt_call.py: using RAC 49 04:29:38.242638 tst mo_mt_call.py: using CellId 38554 04:29:38.362074 tst mo_mt_call.py: using BVCI 38555 04:29:38.473622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:38.484787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:38.495857 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:38.506839 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:38.518116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:38.529205 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:38.643116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:38.765998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:39.238687 run create_hlr_db(pid=8726): Launched 04:29:39.364605 bus /sierra_2: Setting Powered False 04:29:40.425751 run create_hlr_db(pid=8726): Terminated: ok {rc=0} 04:29:40.873053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8728): Launched 04:29:41.201672 run osmo-hlr_10.42.42.2(pid=8729): Launched 04:29:41.328653 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:41.898666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8731): Launched 04:29:42.226103 run osmo-stp_10.42.42.5(pid=8732): Launched 04:29:42.351752 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:42.943369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Launched 04:29:43.272024 run osmo-msc_10.42.42.6(pid=8735): Launched 04:29:43.455585 run osmo-stp_10.42.42.5(pid=8732): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8732)] 04:29:43.594994 run osmo-stp_10.42.42.5(pid=8732): stdout: | (launched: 2022-12-14_04:29:42.165800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:43.734946 run osmo-stp_10.42.42.5(pid=8732): stderr: | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042942357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:43.871902 run osmo-stp_10.42.42.5(pid=8732): stdout: | (launched: 2022-12-14_04:29:42.165800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:44.002196 run osmo-stp_10.42.42.5(pid=8732): stderr: | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042942356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042942357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042942357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:44.158258 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8732): Process ended prematurely: osmo-stp_10.42.42.5(pid=8732) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8732)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:29:44.168128 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:29:44.196361 run osmo-hlr_10.42.42.2(pid=8729): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8729)] 04:29:44.247285 run osmo-hlr_10.42.42.2(pid=8729): stdout: | (launched: 2022-12-14_04:29:41.141467) 04:29:44.299330 run osmo-hlr_10.42.42.2(pid=8729): stderr: | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042941339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042941351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042941360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042941360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042941360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:44.372392 run osmo-msc_10.42.42.6(pid=8735): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8735)] 04:29:44.422867 run osmo-msc_10.42.42.6(pid=8735): stdout: | (launched: 2022-12-14_04:29:43.211622) 04:29:44.475420 run osmo-msc_10.42.42.6(pid=8735): stderr: | [0;m[38;5;43m20221214042943532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042943532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9964eb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042943532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042943532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042943533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042943533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042943534 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042943535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042943535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042943535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:44.527919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8728): Terminating (SIGTERM) 04:29:44.570061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8731): Terminating (SIGTERM) 04:29:44.612859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Terminating (SIGTERM) 04:29:44.655464 --- ParallelTerminationStrategy: PID 8728 died... 04:29:44.675972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8728): Terminated: ok {rc=0} 04:29:44.723006 --- ParallelTerminationStrategy: PID 8731 died... 04:29:44.743001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8731): Terminated: ok {rc=0} 04:29:44.789463 --- ParallelTerminationStrategy: PID 8734 died... 04:29:44.809529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Terminated: ok {rc=0} 04:29:44.897272 bus /sierra_3: Setting Powered False 04:29:46.004201 bus /sierra_3: Setting Powered False 04:29:47.144822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:29:48.291396 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.303622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:29:48.370656 tst mo_mt_call_osmux.py: using LAC 38555 04:29:48.491239 tst mo_mt_call_osmux.py: using RAC 50 04:29:48.619808 tst mo_mt_call_osmux.py: using CellId 38555 04:29:48.750259 tst mo_mt_call_osmux.py: using BVCI 38556 04:29:48.870756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.882561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.894253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.905836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.917846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:29:48.929745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:49.052078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:29:49.173206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:29:49.681994 run create_hlr_db(pid=8737): Launched 04:29:49.808380 bus /sierra_2: Setting Powered False 04:29:50.873281 run create_hlr_db(pid=8737): Terminated: ok {rc=0} 04:29:51.327904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8739): Launched 04:29:51.655744 run osmo-hlr_10.42.42.2(pid=8740): Launched 04:29:51.783232 run osmo-stp_10.42.42.5: Starting osmo-stp 04:29:52.349980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8742): Launched 04:29:52.675990 run osmo-stp_10.42.42.5(pid=8743): Launched 04:29:52.803508 run osmo-msc_10.42.42.6: Starting osmo-msc 04:29:53.395094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8745): Launched 04:29:53.722901 run osmo-msc_10.42.42.6(pid=8746): Launched 04:29:53.908075 run osmo-stp_10.42.42.5(pid=8743): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8743)] 04:29:54.047257 run osmo-stp_10.42.42.5(pid=8743): stdout: | (launched: 2022-12-14_04:29:52.615769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:54.187799 run osmo-stp_10.42.42.5(pid=8743): stderr: | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042952807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:54.325165 run osmo-stp_10.42.42.5(pid=8743): stdout: | (launched: 2022-12-14_04:29:52.615769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:29:54.455183 run osmo-stp_10.42.42.5(pid=8743): stderr: | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214042952807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214042952807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214042952808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:29:54.610994 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8743): Process ended prematurely: osmo-stp_10.42.42.5(pid=8743) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8743)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:29:54.620481 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:29:54.648533 run osmo-hlr_10.42.42.2(pid=8740): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8740)] 04:29:54.699296 run osmo-hlr_10.42.42.2(pid=8740): stdout: | (launched: 2022-12-14_04:29:51.595487) 04:29:54.752164 run osmo-hlr_10.42.42.2(pid=8740): stderr: | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214042951793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214042951803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214042951812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214042951812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214042951812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:29:54.825015 run osmo-msc_10.42.42.6(pid=8746): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8746)] 04:29:54.874872 run osmo-msc_10.42.42.6(pid=8746): stdout: | (launched: 2022-12-14_04:29:53.662521) 04:29:54.926633 run osmo-msc_10.42.42.6(pid=8746): stderr: | [0;m[38;5;43m20221214042953983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214042953983 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f465ed9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214042953983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214042953983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214042953984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214042953984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214042953985 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214042953986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214042953986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214042953986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:29:54.978844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8739): Terminating (SIGTERM) 04:29:55.020543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8742): Terminating (SIGTERM) 04:29:55.063051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8745): Terminating (SIGTERM) 04:29:55.105958 --- ParallelTerminationStrategy: PID 8739 died... 04:29:55.126305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8739): Terminated: ok {rc=0} 04:29:55.173306 --- ParallelTerminationStrategy: PID 8742 died... 04:29:55.193047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8742): Terminated: ok {rc=0} 04:29:55.239422 --- ParallelTerminationStrategy: PID 8745 died... 04:29:55.259347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8745): Terminated: ok {rc=0} 04:29:55.347442 bus /sierra_3: Setting Powered False 04:29:56.445170 bus /sierra_3: Setting Powered False 04:29:57.560362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:29:58.807085 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:29:58.813532 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:29:58.842702 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:29:58.869727 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:29:58.924040 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:29:58.954507 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:29:58.982286 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:29:59.530780 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:29:59.579455 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:29:59.591129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:29:59.657428 tst mo_mt_call.py: using LAC 38556 04:29:59.777490 tst mo_mt_call.py: using RAC 51 04:29:59.900371 tst mo_mt_call.py: using CellId 38556 04:30:00.019098 tst mo_mt_call.py: using BVCI 38557 04:30:00.130337 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:00.141825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:00.153007 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:00.164111 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:00.175362 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:00.186610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:00.307238 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:00.425845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:00.913785 run create_hlr_db(pid=8751): Launched 04:30:01.064028 bus /sierra_2: Setting Powered False 04:30:02.129342 run create_hlr_db(pid=8751): Terminated: ok {rc=0} 04:30:02.604127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Launched 04:30:02.934026 run osmo-hlr_10.42.42.2(pid=8757): Launched 04:30:03.060028 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:03.628252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Launched 04:30:03.955436 run osmo-stp_10.42.42.5(pid=8760): Launched 04:30:04.081010 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:04.674258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Launched 04:30:05.001670 run osmo-msc_10.42.42.6(pid=8763): Launched 04:30:05.186676 run osmo-stp_10.42.42.5(pid=8760): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] 04:30:05.326056 run osmo-stp_10.42.42.5(pid=8760): stdout: | (launched: 2022-12-14_04:30:03.895308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:05.465794 run osmo-stp_10.42.42.5(pid=8760): stderr: | [0;m[38;5;43m20221214043004086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043004087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043004087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043004087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:05.602852 run osmo-stp_10.42.42.5(pid=8760): stdout: | (launched: 2022-12-14_04:30:03.895308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:05.733521 run osmo-stp_10.42.42.5(pid=8760): stderr: | [0;m[38;5;43m20221214043004086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043004087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043004087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043004087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043004088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:05.889399 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8760): Process ended prematurely: osmo-stp_10.42.42.5(pid=8760) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:30:05.898974 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:30:05.926886 run osmo-hlr_10.42.42.2(pid=8757): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8757)] 04:30:05.977630 run osmo-hlr_10.42.42.2(pid=8757): stdout: | (launched: 2022-12-14_04:30:02.873613) 04:30:06.029826 run osmo-hlr_10.42.42.2(pid=8757): stderr: | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043003070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043003082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043003090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043003091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043003091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:06.102290 run osmo-msc_10.42.42.6(pid=8763): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8763)] 04:30:06.152121 run osmo-msc_10.42.42.6(pid=8763): stdout: | (launched: 2022-12-14_04:30:04.941092) 04:30:06.203834 run osmo-msc_10.42.42.6(pid=8763): stderr: | [0;m[38;5;43m20221214043005260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043005260 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1dfafefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043005260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043005260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043005260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043005260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043005262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043005263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043005263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043005263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:06.256126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Terminating (SIGTERM) 04:30:06.298445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Terminating (SIGTERM) 04:30:06.340586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Terminating (SIGTERM) 04:30:06.383525 --- ParallelTerminationStrategy: PID 8756 died... 04:30:06.403893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Terminated: ok {rc=0} 04:30:06.450610 --- ParallelTerminationStrategy: PID 8759 died... 04:30:06.470614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Terminated: ok {rc=0} 04:30:06.517136 --- ParallelTerminationStrategy: PID 8762 died... 04:30:06.537052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Terminated: ok {rc=0} 04:30:06.624850 bus /sierra_3: Setting Powered False 04:30:07.723830 bus /sierra_3: Setting Powered False 04:30:08.839744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:30:09.986557 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:09.998811 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:30:10.068487 tst mo_mt_call_osmux.py: using LAC 38557 04:30:10.188387 tst mo_mt_call_osmux.py: using RAC 52 04:30:10.306295 tst mo_mt_call_osmux.py: using CellId 38557 04:30:10.425126 tst mo_mt_call_osmux.py: using BVCI 38558 04:30:10.534953 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:10.546430 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:10.558022 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:10.569242 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:10.580617 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:30:10.591915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:10.713626 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:30:10.833318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:11.305311 run create_hlr_db(pid=8765): Launched 04:30:11.429298 bus /sierra_2: Setting Powered False 04:30:12.490188 run create_hlr_db(pid=8765): Terminated: ok {rc=0} 04:30:12.936507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8767): Launched 04:30:13.264834 run osmo-hlr_10.42.42.2(pid=8768): Launched 04:30:13.391291 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:13.959337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8770): Launched 04:30:14.288910 run osmo-stp_10.42.42.5(pid=8771): Launched 04:30:14.413596 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:15.004563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8773): Launched 04:30:15.315076 run osmo-msc_10.42.42.6(pid=8774): Launched 04:30:15.485303 run osmo-stp_10.42.42.5(pid=8771): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8771)] 04:30:15.613330 run osmo-stp_10.42.42.5(pid=8771): stdout: | (launched: 2022-12-14_04:30:14.228417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:15.742133 run osmo-stp_10.42.42.5(pid=8771): stderr: | [0;m[38;5;43m20221214043014422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043014422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043014423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043014423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043014423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043014423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043014424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:15.877916 run osmo-stp_10.42.42.5(pid=8771): stdout: | (launched: 2022-12-14_04:30:14.228417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:16.019637 run osmo-stp_10.42.42.5(pid=8771): stderr: | [0;m[38;5;43m20221214043014422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043014422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043014423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043014423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043014423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043014423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043014424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:16.179073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8771): Process ended prematurely: osmo-stp_10.42.42.5(pid=8771) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8771)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:30:16.190881 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:30:16.224835 run osmo-hlr_10.42.42.2(pid=8768): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8768)] 04:30:16.283199 run osmo-hlr_10.42.42.2(pid=8768): stdout: | (launched: 2022-12-14_04:30:13.204464) 04:30:16.344041 run osmo-hlr_10.42.42.2(pid=8768): stderr: | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043013403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043013416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043013424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043013424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043013424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:16.421684 run osmo-msc_10.42.42.6(pid=8774): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8774)] 04:30:16.474227 run osmo-msc_10.42.42.6(pid=8774): stdout: | (launched: 2022-12-14_04:30:15.258391) 04:30:16.529220 run osmo-msc_10.42.42.6(pid=8774): stderr: | [0;m[38;5;43m20221214043015529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043015529 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5843b74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043015529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043015530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043015530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043015530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043015531 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043015532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043015532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043015532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:16.584906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8767): Terminating (SIGTERM) 04:30:16.629507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8770): Terminating (SIGTERM) 04:30:16.675837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8773): Terminating (SIGTERM) 04:30:16.722059 --- ParallelTerminationStrategy: PID 8767 died... 04:30:16.743858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8767): Terminated: ok {rc=0} 04:30:16.793735 --- ParallelTerminationStrategy: PID 8770 died... 04:30:16.815048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8770): Terminated: ok {rc=0} 04:30:16.863592 --- ParallelTerminationStrategy: PID 8773 died... 04:30:16.885154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8773): Terminated: ok {rc=0} 04:30:16.977017 bus /sierra_3: Setting Powered False 04:30:18.079300 bus /sierra_3: Setting Powered False 04:30:19.197255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:30:20.453749 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:20.460057 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:30:20.488773 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 04:30:20.515645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 04:30:20.566988 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:30:20.595619 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 04:30:20.622285 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 04:30:21.172701 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 04:30:21.221905 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.233287 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:30:21.299710 tst mo_mt_call.py: using LAC 38558 04:30:21.419636 tst mo_mt_call.py: using RAC 53 04:30:21.540537 tst mo_mt_call.py: using CellId 38558 04:30:21.660166 tst mo_mt_call.py: using BVCI 38559 04:30:21.772003 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.783124 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.794433 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.805280 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.816613 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:21.828077 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:21.948344 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:22.068225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:22.578410 run create_hlr_db(pid=8780): Launched 04:30:22.706857 bus /sierra_2: Setting Powered False 04:30:23.771512 run create_hlr_db(pid=8780): Terminated: ok {rc=0} 04:30:24.207832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Launched 04:30:24.514916 run osmo-hlr_10.42.42.2(pid=8783): Launched 04:30:24.631151 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:25.173902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Launched 04:30:25.477622 run osmo-stp_10.42.42.5(pid=8786): Launched 04:30:25.592725 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:26.142715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8788): Launched 04:30:26.448368 run osmo-msc_10.42.42.6(pid=8789): Launched 04:30:26.620031 run osmo-stp_10.42.42.5(pid=8786): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] 04:30:26.749580 run osmo-stp_10.42.42.5(pid=8786): stdout: | (launched: 2022-12-14_04:30:25.421244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:26.879679 run osmo-stp_10.42.42.5(pid=8786): stderr: | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043025591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:27.006494 run osmo-stp_10.42.42.5(pid=8786): stdout: | (launched: 2022-12-14_04:30:25.421244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:27.127788 run osmo-stp_10.42.42.5(pid=8786): stderr: | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043025590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043025591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043025591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:27.271860 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8786): Process ended prematurely: osmo-stp_10.42.42.5(pid=8786) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 04:30:27.280666 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:30:27.307337 run osmo-hlr_10.42.42.2(pid=8783): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8783)] 04:30:27.355357 run osmo-hlr_10.42.42.2(pid=8783): stdout: | (launched: 2022-12-14_04:30:24.457818) 04:30:27.404652 run osmo-hlr_10.42.42.2(pid=8783): stderr: | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043024633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043024645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043024653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043024653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043024653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:27.473869 run osmo-msc_10.42.42.6(pid=8789): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8789)] 04:30:27.522212 run osmo-msc_10.42.42.6(pid=8789): stdout: | (launched: 2022-12-14_04:30:26.391550) 04:30:27.571562 run osmo-msc_10.42.42.6(pid=8789): stderr: | [0;m[38;5;43m20221214043026662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043026663 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a5c59dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043026663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043026663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043026663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043026663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043026665 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043026665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043026665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043026665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:27.621290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Terminating (SIGTERM) 04:30:27.661284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Terminating (SIGTERM) 04:30:27.700786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8788): Terminating (SIGTERM) 04:30:27.740606 --- ParallelTerminationStrategy: PID 8782 died... 04:30:27.759851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Terminated: ok {rc=0} 04:30:27.803713 --- ParallelTerminationStrategy: PID 8785 died... 04:30:27.822524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Terminated: ok {rc=0} 04:30:27.866362 --- ParallelTerminationStrategy: PID 8788 died... 04:30:27.885066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8788): Terminated: ok {rc=0} 04:30:27.971293 bus /sierra_3: Setting Powered False 04:30:29.069963 bus /sierra_3: Setting Powered False 04:30:30.184215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 04:30:31.361966 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:31.379706 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:30:31.466691 tst mo_mt_call_osmux.py: using LAC 38559 04:30:31.609760 tst mo_mt_call_osmux.py: using RAC 54 04:30:31.776903 tst mo_mt_call_osmux.py: using CellId 38559 04:30:31.929439 tst mo_mt_call_osmux.py: using BVCI 38560 04:30:32.054244 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:32.067376 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:32.080148 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:32.092715 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:32.106548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 04:30:32.120221 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:32.245645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 04:30:32.371094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:32.880219 run create_hlr_db(pid=8791): Launched 04:30:33.006793 bus /sierra_2: Setting Powered False 04:30:34.070832 run create_hlr_db(pid=8791): Terminated: ok {rc=0} 04:30:34.506206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8793): Launched 04:30:34.813622 run osmo-hlr_10.42.42.2(pid=8794): Launched 04:30:34.928939 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:35.467925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8796): Launched 04:30:35.773593 run osmo-stp_10.42.42.5(pid=8797): Launched 04:30:35.888996 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:36.439196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8799): Launched 04:30:36.744483 run osmo-msc_10.42.42.6(pid=8800): Launched 04:30:36.915947 run osmo-stp_10.42.42.5(pid=8797): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8797)] 04:30:37.044441 run osmo-stp_10.42.42.5(pid=8797): stdout: | (launched: 2022-12-14_04:30:35.716421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:37.172423 run osmo-stp_10.42.42.5(pid=8797): stderr: | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043035890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:37.298633 run osmo-stp_10.42.42.5(pid=8797): stdout: | (launched: 2022-12-14_04:30:35.716421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:37.418723 run osmo-stp_10.42.42.5(pid=8797): stderr: | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043035889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043035890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043035890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:37.563239 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8797): Process ended prematurely: osmo-stp_10.42.42.5(pid=8797) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8797)] [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 04:30:37.572073 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:30:37.598586 run osmo-hlr_10.42.42.2(pid=8794): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8794)] 04:30:37.645934 run osmo-hlr_10.42.42.2(pid=8794): stdout: | (launched: 2022-12-14_04:30:34.756529) 04:30:37.695097 run osmo-hlr_10.42.42.2(pid=8794): stderr: | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043034932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043034944 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043034955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043034955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043034955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:37.764077 run osmo-msc_10.42.42.6(pid=8800): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8800)] 04:30:37.811300 run osmo-msc_10.42.42.6(pid=8800): stdout: | (launched: 2022-12-14_04:30:36.687221) 04:30:37.860694 run osmo-msc_10.42.42.6(pid=8800): stderr: | [0;m[38;5;43m20221214043036961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043036961 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a7743ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043036961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043036961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043036961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043036961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043036963 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043036963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043036964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043036964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:37.910407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8793): Terminating (SIGTERM) 04:30:37.949520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8796): Terminating (SIGTERM) 04:30:37.988645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8799): Terminating (SIGTERM) 04:30:38.028392 --- ParallelTerminationStrategy: PID 8793 died... 04:30:38.047217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8793): Terminated: ok {rc=0} 04:30:38.090995 --- ParallelTerminationStrategy: PID 8796 died... 04:30:38.109569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8796): Terminated: ok {rc=0} 04:30:38.153084 --- ParallelTerminationStrategy: PID 8799 died... 04:30:38.171495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8799): Terminated: ok {rc=0} 04:30:38.256264 bus /sierra_3: Setting Powered False 04:30:39.355071 bus /sierra_3: Setting Powered False 04:30:40.466653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 04:30:41.714148 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:30:41.718920 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:30:41.748863 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:30:41.776897 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:30:41.864508 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:30:41.894152 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:30:41.921670 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:30:42.508722 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 04:30:42.514000 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:42.525358 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:42.571234 tst emergency_mo_mt_call.py: using LAC 38560 04:30:42.696894 tst emergency_mo_mt_call.py: using RAC 55 04:30:42.823980 tst emergency_mo_mt_call.py: using CellId 38560 04:30:42.950192 tst emergency_mo_mt_call.py: using BVCI 38561 04:30:43.066780 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:43.078206 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:43.089362 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:43.100336 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:43.111713 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:43.123233 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:43.239157 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:43.356529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:43.856279 run create_hlr_db(pid=8806): Launched 04:30:43.977982 bus /sierra_2: Setting Powered False 04:30:45.037939 run create_hlr_db(pid=8806): Terminated: ok {rc=0} 04:30:45.486926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Launched 04:30:45.810339 run osmo-hlr_10.42.42.2(pid=8809): Launched 04:30:45.944458 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:46.680857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Launched 04:30:47.056743 run osmo-stp_10.42.42.5(pid=8812): Launched 04:30:47.411900 tst emergency_mo_mt_call.py: using MSISDN 8502 04:30:47.569821 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:48.114080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Launched 04:30:48.413715 run osmo-msc_10.42.42.6(pid=8815): Launched 04:30:48.581276 run osmo-stp_10.42.42.5(pid=8812): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] 04:30:48.708075 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-14_04:30:46.985937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:48.833972 run osmo-stp_10.42.42.5(pid=8812): stderr: | [0;m[38;5;43m20221214043047236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043047236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043047237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043047237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:48.958146 run osmo-stp_10.42.42.5(pid=8812): stdout: | (launched: 2022-12-14_04:30:46.985937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:49.076330 run osmo-stp_10.42.42.5(pid=8812): stderr: | [0;m[38;5;43m20221214043047236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043047236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043047237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043047237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043047238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:49.218308 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 04:30:49.226565 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 04:30:49.252656 run osmo-hlr_10.42.42.2(pid=8809): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8809)] 04:30:49.300934 run osmo-hlr_10.42.42.2(pid=8809): stdout: | (launched: 2022-12-14_04:30:45.750782) 04:30:49.350577 run osmo-hlr_10.42.42.2(pid=8809): stderr: | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043046077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043046091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043046107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043046107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043046107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:49.419348 run osmo-msc_10.42.42.6(pid=8815): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8815)] 04:30:49.467026 run osmo-msc_10.42.42.6(pid=8815): stdout: | (launched: 2022-12-14_04:30:48.358183) 04:30:49.516216 run osmo-msc_10.42.42.6(pid=8815): stderr: | [0;m[38;5;43m20221214043048629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043048629 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb3cdbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043048629 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043048629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043048629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043048630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043048631 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043048632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043048632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043048632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:49.566066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminating (SIGTERM) 04:30:49.605724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminating (SIGTERM) 04:30:49.645306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminating (SIGTERM) 04:30:49.685802 --- ParallelTerminationStrategy: PID 8808 died... 04:30:49.704777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8808): Terminated: ok {rc=0} 04:30:49.748467 --- ParallelTerminationStrategy: PID 8811 died... 04:30:49.766919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8811): Terminated: ok {rc=0} 04:30:49.810884 --- ParallelTerminationStrategy: PID 8814 died... 04:30:49.829503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8814): Terminated: ok {rc=0} 04:30:49.913192 bus /sierra_3: Setting Powered False 04:30:51.011714 bus /sierra_3: Setting Powered False 04:30:52.129257 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 04:30:53.216713 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.228437 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:30:53.273627 tst emergency_preemptive_call.py: using LAC 38561 04:30:53.390445 tst emergency_preemptive_call.py: using RAC 56 04:30:53.507003 tst emergency_preemptive_call.py: using CellId 38561 04:30:53.625140 tst emergency_preemptive_call.py: using BVCI 38562 04:30:53.732466 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.743330 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.753930 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.764404 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.775041 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:30:53.786056 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:53.905411 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:54.020473 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:54.141506 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:30:54.258328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:30:54.722865 run create_hlr_db(pid=8817): Launched 04:30:54.844733 bus /sierra_2: Setting Powered False 04:30:55.904783 run create_hlr_db(pid=8817): Terminated: ok {rc=0} 04:30:56.322651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8819): Launched 04:30:56.621372 run osmo-hlr_10.42.42.2(pid=8820): Launched 04:30:56.735841 run osmo-stp_10.42.42.5: Starting osmo-stp 04:30:57.287319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8822): Launched 04:30:57.586630 run osmo-stp_10.42.42.5(pid=8823): Launched 04:30:57.711803 tst emergency_preemptive_call.py: using MSISDN 8503 04:30:57.865422 run osmo-msc_10.42.42.6: Starting osmo-msc 04:30:58.403127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8825): Launched 04:30:58.702537 run osmo-msc_10.42.42.6(pid=8826): Launched 04:30:58.871782 run osmo-stp_10.42.42.5(pid=8823): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8823)] 04:30:58.998248 run osmo-stp_10.42.42.5(pid=8823): stdout: | (launched: 2022-12-14_04:30:57.530292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:59.124887 run osmo-stp_10.42.42.5(pid=8823): stderr: | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043057701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:59.248938 run osmo-stp_10.42.42.5(pid=8823): stdout: | (launched: 2022-12-14_04:30:57.530292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:30:59.366838 run osmo-stp_10.42.42.5(pid=8823): stderr: | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043057700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043057701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043057701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:30:59.507958 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8823): Process ended prematurely: osmo-stp_10.42.42.5(pid=8823) [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8823)] [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 04:30:59.516432 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 04:30:59.542479 run osmo-hlr_10.42.42.2(pid=8820): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8820)] 04:30:59.589977 run osmo-hlr_10.42.42.2(pid=8820): stdout: | (launched: 2022-12-14_04:30:56.565704) 04:30:59.639305 run osmo-hlr_10.42.42.2(pid=8820): stderr: | [0;m[1;31m20221214043056741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043056741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043056741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043056741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043056741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043056742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043056754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043056762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043056763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043056763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:30:59.708078 run osmo-msc_10.42.42.6(pid=8826): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8826)] 04:30:59.755579 run osmo-msc_10.42.42.6(pid=8826): stdout: | (launched: 2022-12-14_04:30:58.646854) 04:30:59.804624 run osmo-msc_10.42.42.6(pid=8826): stderr: | [0;m[38;5;43m20221214043058919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043058920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff159e22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043058920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043058920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043058920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043058920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043058922 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043058922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043058923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043058923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:30:59.854242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8819): Terminating (SIGTERM) 04:30:59.893518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8822): Terminating (SIGTERM) 04:30:59.932684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8825): Terminating (SIGTERM) 04:30:59.972259 --- ParallelTerminationStrategy: PID 8819 died... 04:30:59.991181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8819): Terminated: ok {rc=0} 04:31:00.035047 --- ParallelTerminationStrategy: PID 8822 died... 04:31:00.053842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8822): Terminated: ok {rc=0} 04:31:00.097399 --- ParallelTerminationStrategy: PID 8825 died... 04:31:00.116060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8825): Terminated: ok {rc=0} 04:31:00.198850 bus /sierra_9: Setting Powered False 04:31:01.300043 bus /sierra_9: Setting Powered False 04:31:02.426793 bus /sierra_8: Setting Powered False 04:31:03.525406 bus /sierra_8: Setting Powered False 04:31:04.644321 bus /sierra_3: Setting Powered False 04:31:05.742896 bus /sierra_3: Setting Powered False 04:31:06.860089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 04:31:08.132325 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:31:08.137067 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 04:31:08.165864 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 04:31:08.204094 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 04:31:08.291258 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 04:31:08.320149 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 04:31:08.358365 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 04:31:08.955446 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 04:31:09.004467 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.015352 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:09.058517 tst cs_paging_gprs_active.py: using LAC 38562 04:31:09.178380 tst cs_paging_gprs_active.py: using RAC 57 04:31:09.295526 tst cs_paging_gprs_active.py: using CellId 38562 04:31:09.412855 tst cs_paging_gprs_active.py: using BVCI 38563 04:31:09.524819 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.535605 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.546218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.556666 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.567268 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.578282 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.589289 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.599726 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:09.610377 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:09.727303 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:09.845204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:31:10.068262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:10.398076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8831): Launched 04:31:10.684239 run iperf3-srv_10.42.42.10(pid=8832): Launched 04:31:10.809217 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:31:11.030450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:11.360040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8833): Launched 04:31:11.647577 run iperf3-srv_10.42.42.10(pid=8834): Launched 04:31:11.771955 tst cs_paging_gprs_active.py:38: start network... 04:31:11.992690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:12.500501 run create_hlr_db(pid=8835): Launched 04:31:12.626689 bus /sierra_2: Setting Powered False 04:31:13.691241 run create_hlr_db(pid=8835): Terminated: ok {rc=0} 04:31:14.147387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Launched 04:31:14.475147 run osmo-hlr_10.42.42.2(pid=8838): Launched 04:31:14.601744 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:15.168659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Launched 04:31:15.498555 run osmo-stp_10.42.42.5(pid=8841): Launched 04:31:15.625221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:16.217716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8843): Launched 04:31:16.345367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:16.613477 run patchelf(pid=8844): Launched 04:31:16.805812 run osmo-stp_10.42.42.5(pid=8841): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] 04:31:16.940830 run osmo-stp_10.42.42.5(pid=8841): stdout: | (launched: 2022-12-14_04:31:15.437980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:17.076769 run osmo-stp_10.42.42.5(pid=8841): stderr: | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043115630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:17.212699 run osmo-stp_10.42.42.5(pid=8841): stdout: | (launched: 2022-12-14_04:31:15.437980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:17.337951 run osmo-stp_10.42.42.5(pid=8841): stderr: | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043115629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043115630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043115630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:17.486291 run patchelf(pid=8844): Terminating (SIGINT) 04:31:17.657586 run patchelf(pid=8844): Terminated: ok {rc=0} 04:31:17.781549 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8841): Process ended prematurely: osmo-stp_10.42.42.5(pid=8841) [trial-2399↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] [trial-2399↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 04:31:17.791373 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:31:17.819039 run osmo-hlr_10.42.42.2(pid=8838): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8838)] 04:31:17.867050 run osmo-hlr_10.42.42.2(pid=8838): stdout: | (launched: 2022-12-14_04:31:14.414676) 04:31:17.916574 run osmo-hlr_10.42.42.2(pid=8838): stderr: | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043114612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043114624 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043114633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043114633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043114633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:17.966706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8831): Terminating (SIGTERM) 04:31:18.006271 run iperf3-srv_10.42.42.10(pid=8832): Terminating (SIGTERM) 04:31:18.045713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8833): Terminating (SIGTERM) 04:31:18.085344 run iperf3-srv_10.42.42.10(pid=8834): Terminating (SIGTERM) 04:31:18.124853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Terminating (SIGTERM) 04:31:18.164359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Terminating (SIGTERM) 04:31:18.203775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8843): Terminating (SIGTERM) 04:31:18.243819 --- ParallelTerminationStrategy: PID 8831 died... 04:31:18.263332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8831): Terminated: ok {rc=0} 04:31:18.307905 --- ParallelTerminationStrategy: PID 8832 died... 04:31:18.326673 run iperf3-srv_10.42.42.10(pid=8832): Terminated {rc=256} 04:31:18.371082 --- ParallelTerminationStrategy: PID 8833 died... 04:31:18.390006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8833): Terminated: ok {rc=0} 04:31:18.434173 --- ParallelTerminationStrategy: PID 8834 died... 04:31:18.453161 run iperf3-srv_10.42.42.10(pid=8834): Terminated {rc=256} 04:31:18.497202 --- ParallelTerminationStrategy: PID 8837 died... 04:31:18.515989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8837): Terminated: ok {rc=0} 04:31:18.560200 --- ParallelTerminationStrategy: PID 8840 died... 04:31:18.579277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8840): Terminated: ok {rc=0} 04:31:18.623178 --- ParallelTerminationStrategy: PID 8843 died... 04:31:18.642254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8843): Terminated: ok {rc=0} 04:31:18.728251 bus /gobi_0: Setting Powered False 04:31:19.829200 bus /gobi_0: Setting Powered False 04:31:20.944913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 04:31:22.096246 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.108543 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:22.157833 tst iperf3.py: using LAC 38563 04:31:22.277449 tst iperf3.py: using RAC 58 04:31:22.395815 tst iperf3.py: using CellId 38563 04:31:22.516452 tst iperf3.py: using BVCI 38564 04:31:22.627948 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.638762 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.649280 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.659826 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.670361 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.681253 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.691881 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.702730 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:22.713551 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:22.834211 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:23.038184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:23.343979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Launched 04:31:23.609267 run iperf3-srv_10.42.42.10(pid=8846): Launched 04:31:23.722715 tst iperf3.py:8: start network... 04:31:23.924704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:24.394954 run create_hlr_db(pid=8847): Launched 04:31:24.518831 bus /gobi_6: Setting Powered False 04:31:25.579951 run create_hlr_db(pid=8847): Terminated: ok {rc=0} 04:31:26.025208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Launched 04:31:26.351505 run osmo-hlr_10.42.42.2(pid=8850): Launched 04:31:26.477646 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:27.047564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Launched 04:31:27.377582 run osmo-stp_10.42.42.5(pid=8853): Launched 04:31:27.503435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:28.067999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Launched 04:31:28.194520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:28.471530 run patchelf(pid=8856): Launched 04:31:28.655110 run osmo-stp_10.42.42.5(pid=8853): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] 04:31:28.793688 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-14_04:31:27.316786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:28.933688 run osmo-stp_10.42.42.5(pid=8853): stderr: | [0;m[38;5;43m20221214043127507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043127507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043127508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043127508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:29.073802 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-14_04:31:27.316786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:29.208046 run osmo-stp_10.42.42.5(pid=8853): stderr: | [0;m[38;5;43m20221214043127507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043127507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043127508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043127508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043127509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:29.367373 run patchelf(pid=8856): Terminating (SIGINT) 04:31:29.549975 run patchelf(pid=8856): Terminated: ok {rc=0} 04:31:29.681815 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 04:31:29.692226 tst iperf3.py:8: Test FAILED (7.6 sec) 04:31:29.721005 run osmo-hlr_10.42.42.2(pid=8850): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8850)] 04:31:29.771845 run osmo-hlr_10.42.42.2(pid=8850): stdout: | (launched: 2022-12-14_04:31:26.291422) 04:31:29.824143 run osmo-hlr_10.42.42.2(pid=8850): stderr: | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043126490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043126502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043126510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043126511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043126511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:29.876124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Terminating (SIGTERM) 04:31:29.918124 run iperf3-srv_10.42.42.10(pid=8846): Terminating (SIGTERM) 04:31:29.960555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminating (SIGTERM) 04:31:30.002533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminating (SIGTERM) 04:31:30.044913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminating (SIGTERM) 04:31:30.087489 --- ParallelTerminationStrategy: PID 8845 died... 04:31:30.108237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Terminated: ok {rc=0} 04:31:30.155032 --- ParallelTerminationStrategy: PID 8846 died... 04:31:30.175166 run iperf3-srv_10.42.42.10(pid=8846): Terminated {rc=256} 04:31:30.221793 --- ParallelTerminationStrategy: PID 8849 died... 04:31:30.242089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminated: ok {rc=0} 04:31:30.288662 --- ParallelTerminationStrategy: PID 8852 died... 04:31:30.308891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminated: ok {rc=0} 04:31:30.355491 --- ParallelTerminationStrategy: PID 8855 died... 04:31:30.375828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminated: ok {rc=0} 04:31:30.464677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 04:31:31.641498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:31.657808 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:31.712321 tst iperf3m4.py: using LAC 38564 04:31:31.848886 tst iperf3m4.py: using RAC 59 04:31:32.014654 tst iperf3m4.py: using CellId 38564 04:31:32.162346 tst iperf3m4.py: using BVCI 38565 04:31:32.289533 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.300656 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.312502 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.323899 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.334466 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.344922 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.355638 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.366145 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:32.376750 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:32.497782 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:32.616162 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:32.736146 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:32.855497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:31:33.059885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:33.365286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Launched 04:31:33.629851 run iperf3-srv_10.42.42.10(pid=8858): Launched 04:31:33.753929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:31:33.974694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:34.304309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Launched 04:31:34.589226 run iperf3-srv_10.42.42.10(pid=8860): Launched 04:31:34.711782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:31:34.932342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:35.261622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Launched 04:31:35.547351 run iperf3-srv_10.42.42.10(pid=8862): Launched 04:31:35.671913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:31:35.892658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:31:36.222293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Launched 04:31:36.507745 run iperf3-srv_10.42.42.10(pid=8864): Launched 04:31:36.632464 tst iperf3m4.py:8: start network... 04:31:36.853481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:37.361249 run create_hlr_db(pid=8865): Launched 04:31:37.487563 bus /gobi_6: Setting Powered False 04:31:38.552459 run create_hlr_db(pid=8865): Terminated: ok {rc=0} 04:31:39.007394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Launched 04:31:39.336861 run osmo-hlr_10.42.42.2(pid=8868): Launched 04:31:39.461572 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:40.130824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Launched 04:31:40.452203 run osmo-stp_10.42.42.5(pid=8871): Launched 04:31:40.574248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:41.126848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Launched 04:31:41.249092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:41.519746 run patchelf(pid=8874): Launched 04:31:41.697072 run osmo-stp_10.42.42.5(pid=8871): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] 04:31:41.833256 run osmo-stp_10.42.42.5(pid=8871): stdout: | (launched: 2022-12-14_04:31:40.392851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:41.970434 run osmo-stp_10.42.42.5(pid=8871): stderr: | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043140582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:42.107520 run osmo-stp_10.42.42.5(pid=8871): stdout: | (launched: 2022-12-14_04:31:40.392851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:42.239117 run osmo-stp_10.42.42.5(pid=8871): stderr: | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043140582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043140582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043140583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:42.394995 run patchelf(pid=8874): Terminating (SIGINT) 04:31:42.573876 run patchelf(pid=8874): Terminated: ok {rc=0} 04:31:42.702843 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8871): Process ended prematurely: osmo-stp_10.42.42.5(pid=8871) [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 04:31:42.713155 tst iperf3m4.py:8: Test FAILED (11.1 sec) 04:31:42.742061 run osmo-hlr_10.42.42.2(pid=8868): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8868)] 04:31:42.793163 run osmo-hlr_10.42.42.2(pid=8868): stdout: | (launched: 2022-12-14_04:31:39.275960) 04:31:42.845820 run osmo-hlr_10.42.42.2(pid=8868): stderr: | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043139473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043139486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043139496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043139496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043139496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:42.897964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminating (SIGTERM) 04:31:42.939922 run iperf3-srv_10.42.42.10(pid=8858): Terminating (SIGTERM) 04:31:42.982228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminating (SIGTERM) 04:31:43.024061 run iperf3-srv_10.42.42.10(pid=8860): Terminating (SIGTERM) 04:31:43.066305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Terminating (SIGTERM) 04:31:43.108317 run iperf3-srv_10.42.42.10(pid=8862): Terminating (SIGTERM) 04:31:43.150469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Terminating (SIGTERM) 04:31:43.192313 run iperf3-srv_10.42.42.10(pid=8864): Terminating (SIGTERM) 04:31:43.234632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Terminating (SIGTERM) 04:31:43.276592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Terminating (SIGTERM) 04:31:43.318895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Terminating (SIGTERM) 04:31:43.361341 --- ParallelTerminationStrategy: PID 8857 died... 04:31:43.382148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminated: ok {rc=0} 04:31:43.428405 --- ParallelTerminationStrategy: PID 8858 died... 04:31:43.448235 run iperf3-srv_10.42.42.10(pid=8858): Terminated {rc=256} 04:31:43.494333 --- ParallelTerminationStrategy: PID 8859 died... 04:31:43.514319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminated: ok {rc=0} 04:31:43.560406 --- ParallelTerminationStrategy: PID 8860 died... 04:31:43.580492 run iperf3-srv_10.42.42.10(pid=8860): Terminated {rc=256} 04:31:43.626937 --- ParallelTerminationStrategy: PID 8861 died... 04:31:43.646955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8861): Terminated: ok {rc=0} 04:31:43.693113 --- ParallelTerminationStrategy: PID 8862 died... 04:31:43.713008 run iperf3-srv_10.42.42.10(pid=8862): Terminated {rc=256} 04:31:43.759137 --- ParallelTerminationStrategy: PID 8863 died... 04:31:43.779351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8863): Terminated: ok {rc=0} 04:31:43.825783 --- ParallelTerminationStrategy: PID 8864 died... 04:31:43.845576 run iperf3-srv_10.42.42.10(pid=8864): Terminated {rc=256} 04:31:43.891599 --- ParallelTerminationStrategy: PID 8867 died... 04:31:43.911816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8867): Terminated: ok {rc=0} 04:31:43.957899 --- ParallelTerminationStrategy: PID 8870 died... 04:31:43.977641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8870): Terminated: ok {rc=0} 04:31:44.023541 --- ParallelTerminationStrategy: PID 8873 died... 04:31:44.043456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8873): Terminated: ok {rc=0} 04:31:44.131219 bus /gobi_4: Setting Powered False 04:31:45.230807 bus /gobi_4: Setting Powered False 04:31:46.349380 bus /gobi_1: Setting Powered False 04:31:47.450538 bus /gobi_1: Setting Powered False 04:31:48.565797 bus /gobi_0: Setting Powered False 04:31:49.663812 bus /gobi_0: Setting Powered False 04:31:50.783054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 04:31:51.886914 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:51.898846 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:31:51.943966 tst ping.py: using LAC 38565 04:31:52.058801 tst ping.py: using RAC 60 04:31:52.174844 tst ping.py: using CellId 38565 04:31:52.289165 tst ping.py: using BVCI 38566 04:31:52.394436 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.405308 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.415875 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.426325 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.436726 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.447749 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.458875 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:31:52.469509 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:31:52.582002 tst ping.py:19: start network... 04:31:52.775158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:31:53.227204 run create_hlr_db(pid=8875): Launched 04:31:53.346270 bus /gobi_6: Setting Powered False 04:31:54.406095 run create_hlr_db(pid=8875): Terminated: ok {rc=0} 04:31:54.836416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Launched 04:31:55.151041 run osmo-hlr_10.42.42.2(pid=8878): Launched 04:31:55.272738 run osmo-stp_10.42.42.5: Starting osmo-stp 04:31:55.818955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Launched 04:31:56.133185 run osmo-stp_10.42.42.5(pid=8881): Launched 04:31:56.254276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:31:56.796662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Launched 04:31:56.916326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:31:57.181712 run patchelf(pid=8884): Launched 04:31:57.357619 run osmo-stp_10.42.42.5(pid=8881): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] 04:31:57.490848 run osmo-stp_10.42.42.5(pid=8881): stdout: | (launched: 2022-12-14_04:31:56.075264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:57.626109 run osmo-stp_10.42.42.5(pid=8881): stderr: | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043156265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:57.761632 run osmo-stp_10.42.42.5(pid=8881): stdout: | (launched: 2022-12-14_04:31:56.075264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:31:57.890806 run osmo-stp_10.42.42.5(pid=8881): stderr: | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043156265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043156265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043156266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:31:58.043587 run patchelf(pid=8884): Terminating (SIGINT) 04:31:58.219259 run patchelf(pid=8884): Terminated: ok {rc=0} 04:31:58.345843 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8881): Process ended prematurely: osmo-stp_10.42.42.5(pid=8881) [trial-2399↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] [trial-2399↪gprs:trx-lms-limenet-micro↪ping.py:22] 04:31:58.355640 tst ping.py:22: Test FAILED (6.5 sec) 04:31:58.383438 run osmo-hlr_10.42.42.2(pid=8878): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8878)] 04:31:58.434082 run osmo-hlr_10.42.42.2(pid=8878): stdout: | (launched: 2022-12-14_04:31:55.092762) 04:31:58.486296 run osmo-hlr_10.42.42.2(pid=8878): stderr: | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043155289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043155300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043155308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043155309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043155309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:31:58.538481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Terminating (SIGTERM) 04:31:58.580295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Terminating (SIGTERM) 04:31:58.622188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Terminating (SIGTERM) 04:31:58.664249 --- ParallelTerminationStrategy: PID 8877 died... 04:31:58.684464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Terminated: ok {rc=0} 04:31:58.731145 --- ParallelTerminationStrategy: PID 8880 died... 04:31:58.750970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Terminated: ok {rc=0} 04:31:58.797435 --- ParallelTerminationStrategy: PID 8883 died... 04:31:58.817239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Terminated: ok {rc=0} 04:31:58.905801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 04:31:59.992560 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.004557 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 04:32:00.051943 tst ping_idle_ping.py: using LAC 38566 04:32:00.176385 tst ping_idle_ping.py: using RAC 61 04:32:00.304343 tst ping_idle_ping.py: using CellId 38566 04:32:00.427788 tst ping_idle_ping.py: using BVCI 38567 04:32:00.543443 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.554937 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.566277 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.577309 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.588719 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.600161 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.611874 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 04:32:00.623421 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 04:32:00.741932 tst ping_idle_ping.py:24: start network... 04:32:00.971201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:01.469746 run create_hlr_db(pid=8885): Launched 04:32:01.623817 bus /gobi_6: Setting Powered False 04:32:02.683856 run create_hlr_db(pid=8885): Terminated: ok {rc=0} 04:32:03.135598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Launched 04:32:03.452820 run osmo-hlr_10.42.42.2(pid=8888): Launched 04:32:03.572598 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:04.126301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Launched 04:32:04.440868 run osmo-stp_10.42.42.5(pid=8891): Launched 04:32:04.560664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:05.106428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Launched 04:32:05.226837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:05.494275 run patchelf(pid=8894): Launched 04:32:05.669192 run osmo-stp_10.42.42.5(pid=8891): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] 04:32:05.803992 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-14_04:32:04.382843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:05.940301 run osmo-stp_10.42.42.5(pid=8891): stderr: | [0;m[38;5;43m20221214043204570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043204571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043204571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043204571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:06.076568 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-14_04:32:04.382843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:06.206580 run osmo-stp_10.42.42.5(pid=8891): stderr: | [0;m[38;5;43m20221214043204570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043204571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043204571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043204571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043204572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:06.360096 run patchelf(pid=8894): Terminating (SIGINT) 04:32:06.536552 run patchelf(pid=8894): Terminated: ok {rc=0} 04:32:06.663931 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2399↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] [trial-2399↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 04:32:06.673669 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:32:06.701478 run osmo-hlr_10.42.42.2(pid=8888): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8888)] 04:32:06.752232 run osmo-hlr_10.42.42.2(pid=8888): stdout: | (launched: 2022-12-14_04:32:03.394347) 04:32:06.804928 run osmo-hlr_10.42.42.2(pid=8888): stderr: | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043203590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043203606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043203614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043203614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043203614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:06.857727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminating (SIGTERM) 04:32:06.899425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminating (SIGTERM) 04:32:06.942034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminating (SIGTERM) 04:32:06.984293 --- ParallelTerminationStrategy: PID 8887 died... 04:32:07.004675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminated: ok {rc=0} 04:32:07.051159 --- ParallelTerminationStrategy: PID 8890 died... 04:32:07.071212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminated: ok {rc=0} 04:32:07.117473 --- ParallelTerminationStrategy: PID 8893 died... 04:32:07.137429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminated: ok {rc=0} 04:32:07.226086 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 04:32:08.528804 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:32:08.534690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:32:08.564344 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:32:08.604307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:32:08.693402 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:32:08.722866 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:32:08.762304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:32:09.359125 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:32:09.410953 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:09.422397 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:09.470362 tst cs_paging_gprs_active.py: using LAC 38567 04:32:09.596933 tst cs_paging_gprs_active.py: using RAC 62 04:32:09.722749 tst cs_paging_gprs_active.py: using CellId 38567 04:32:09.849363 tst cs_paging_gprs_active.py: using BVCI 38568 04:32:09.958395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:09.969670 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:09.980612 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:09.991564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:10.002537 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:10.013497 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:10.024548 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:10.038648 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:10.050426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:10.167832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:10.288127 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:32:10.505462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:10.828159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8898): Launched 04:32:11.107710 run iperf3-srv_10.42.42.10(pid=8899): Launched 04:32:11.227958 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:32:11.444102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:11.766578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8900): Launched 04:32:12.047009 run iperf3-srv_10.42.42.10(pid=8901): Launched 04:32:12.168460 tst cs_paging_gprs_active.py:38: start network... 04:32:12.384026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:12.883199 run create_hlr_db(pid=8902): Launched 04:32:13.005805 bus /gobi_6: Setting Powered False 04:32:14.070015 run create_hlr_db(pid=8902): Terminated: ok {rc=0} 04:32:14.500357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8904): Launched 04:32:14.801271 run osmo-hlr_10.42.42.2(pid=8905): Launched 04:32:14.915087 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:15.439061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8907): Launched 04:32:15.739012 run osmo-stp_10.42.42.5(pid=8908): Launched 04:32:15.888859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:16.596360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8910): Launched 04:32:16.732201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:17.021754 run patchelf(pid=8911): Launched 04:32:17.200244 run osmo-stp_10.42.42.5(pid=8908): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8908)] 04:32:17.328877 run osmo-stp_10.42.42.5(pid=8908): stdout: | (launched: 2022-12-14_04:32:15.683075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:17.458203 run osmo-stp_10.42.42.5(pid=8908): stderr: | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043215895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:17.586634 run osmo-stp_10.42.42.5(pid=8908): stdout: | (launched: 2022-12-14_04:32:15.683075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:17.709574 run osmo-stp_10.42.42.5(pid=8908): stderr: | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043215894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043215895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043215895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:17.855182 run patchelf(pid=8911): Terminating (SIGINT) 04:32:18.023141 run patchelf(pid=8911): Terminated: ok {rc=0} 04:32:18.144476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8908): Process ended prematurely: osmo-stp_10.42.42.5(pid=8908) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8908)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:32:18.154364 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:32:18.181602 run osmo-hlr_10.42.42.2(pid=8905): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8905)] 04:32:18.229521 run osmo-hlr_10.42.42.2(pid=8905): stdout: | (launched: 2022-12-14_04:32:14.744909) 04:32:18.278968 run osmo-hlr_10.42.42.2(pid=8905): stderr: | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043214919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043214932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043214940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043214941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043214941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:18.329037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8898): Terminating (SIGTERM) 04:32:18.368748 run iperf3-srv_10.42.42.10(pid=8899): Terminating (SIGTERM) 04:32:18.408237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8900): Terminating (SIGTERM) 04:32:18.447812 run iperf3-srv_10.42.42.10(pid=8901): Terminating (SIGTERM) 04:32:18.487186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8904): Terminating (SIGTERM) 04:32:18.526464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8907): Terminating (SIGTERM) 04:32:18.565830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8910): Terminating (SIGTERM) 04:32:18.605507 --- ParallelTerminationStrategy: PID 8898 died... 04:32:18.624576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8898): Terminated: ok {rc=0} 04:32:18.668545 --- ParallelTerminationStrategy: PID 8899 died... 04:32:18.687152 run iperf3-srv_10.42.42.10(pid=8899): Terminated {rc=256} 04:32:18.730661 --- ParallelTerminationStrategy: PID 8900 died... 04:32:18.749427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8900): Terminated: ok {rc=0} 04:32:18.793182 --- ParallelTerminationStrategy: PID 8901 died... 04:32:18.811758 run iperf3-srv_10.42.42.10(pid=8901): Terminated {rc=256} 04:32:18.855471 --- ParallelTerminationStrategy: PID 8904 died... 04:32:18.874247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8904): Terminated: ok {rc=0} 04:32:18.917913 --- ParallelTerminationStrategy: PID 8907 died... 04:32:18.936689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8907): Terminated: ok {rc=0} 04:32:18.980726 --- ParallelTerminationStrategy: PID 8910 died... 04:32:18.999528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8910): Terminated: ok {rc=0} 04:32:19.085730 bus /gobi_0: Setting Powered False 04:32:20.185441 bus /gobi_0: Setting Powered False 04:32:21.302208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:32:22.452811 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:22.464924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:22.514032 tst iperf3.py: using LAC 38568 04:32:22.632776 tst iperf3.py: using RAC 63 04:32:22.751850 tst iperf3.py: using CellId 38568 04:32:22.871332 tst iperf3.py: using BVCI 38569 04:32:22.981232 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:22.992586 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.003493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.014355 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.025143 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.035859 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.046689 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.057422 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:23.068318 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:23.188468 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:23.389507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:23.690142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8912): Launched 04:32:23.952079 run iperf3-srv_10.42.42.10(pid=8913): Launched 04:32:24.064338 tst iperf3.py:8: start network... 04:32:24.264042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:24.729440 run create_hlr_db(pid=8914): Launched 04:32:24.853901 bus /gobi_6: Setting Powered False 04:32:25.913575 run create_hlr_db(pid=8914): Terminated: ok {rc=0} 04:32:26.330960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8916): Launched 04:32:26.630075 run osmo-hlr_10.42.42.2(pid=8917): Launched 04:32:26.743079 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:27.258340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8919): Launched 04:32:27.557010 run osmo-stp_10.42.42.5(pid=8920): Launched 04:32:27.669967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:28.183726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8922): Launched 04:32:28.297398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:28.549606 run patchelf(pid=8923): Launched 04:32:28.715481 run osmo-stp_10.42.42.5(pid=8920): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8920)] 04:32:28.841995 run osmo-stp_10.42.42.5(pid=8920): stdout: | (launched: 2022-12-14_04:32:27.501527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:28.970193 run osmo-stp_10.42.42.5(pid=8920): stderr: | [0;m[38;5;43m20221214043227672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043227672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043227673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043227673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:29.098419 run osmo-stp_10.42.42.5(pid=8920): stdout: | (launched: 2022-12-14_04:32:27.501527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:29.220915 run osmo-stp_10.42.42.5(pid=8920): stderr: | [0;m[38;5;43m20221214043227672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043227672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043227673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043227673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043227674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:29.366334 run patchelf(pid=8923): Terminating (SIGINT) 04:32:29.535043 run patchelf(pid=8923): Terminated: ok {rc=0} 04:32:29.655751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8920): Process ended prematurely: osmo-stp_10.42.42.5(pid=8920) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8920)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 04:32:29.665316 tst iperf3.py:8: Test FAILED (7.3 sec) 04:32:29.692182 run osmo-hlr_10.42.42.2(pid=8917): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8917)] 04:32:29.739158 run osmo-hlr_10.42.42.2(pid=8917): stdout: | (launched: 2022-12-14_04:32:26.573903) 04:32:29.787883 run osmo-hlr_10.42.42.2(pid=8917): stderr: | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043226749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043226766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043226775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043226776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043226776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:29.837320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8912): Terminating (SIGTERM) 04:32:29.876861 run iperf3-srv_10.42.42.10(pid=8913): Terminating (SIGTERM) 04:32:29.916038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8916): Terminating (SIGTERM) 04:32:29.955279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8919): Terminating (SIGTERM) 04:32:29.994624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8922): Terminating (SIGTERM) 04:32:30.034410 --- ParallelTerminationStrategy: PID 8912 died... 04:32:30.053509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8912): Terminated: ok {rc=0} 04:32:30.097336 --- ParallelTerminationStrategy: PID 8913 died... 04:32:30.115749 run iperf3-srv_10.42.42.10(pid=8913): Terminated {rc=256} 04:32:30.159275 --- ParallelTerminationStrategy: PID 8916 died... 04:32:30.177807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8916): Terminated: ok {rc=0} 04:32:30.221302 --- ParallelTerminationStrategy: PID 8919 died... 04:32:30.239956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8919): Terminated: ok {rc=0} 04:32:30.283729 --- ParallelTerminationStrategy: PID 8922 died... 04:32:30.302440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8922): Terminated: ok {rc=0} 04:32:30.388100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:32:31.532220 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:31.544395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:31.591432 tst iperf3m4.py: using LAC 38569 04:32:31.754412 tst iperf3m4.py: using RAC 64 04:32:31.920411 tst iperf3m4.py: using CellId 38569 04:32:32.085498 tst iperf3m4.py: using BVCI 38570 04:32:32.204804 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.217495 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.229881 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.242229 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.255707 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.269248 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.282564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.295500 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:32.308865 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:32.431661 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:32.551803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:32.671771 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:32.791732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:32:33.007682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:33.328871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Launched 04:32:33.607997 run iperf3-srv_10.42.42.10(pid=8925): Launched 04:32:33.728203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:32:33.944167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:34.266118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8926): Launched 04:32:34.546491 run iperf3-srv_10.42.42.10(pid=8927): Launched 04:32:34.669025 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:32:34.885001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:35.207856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Launched 04:32:35.487168 run iperf3-srv_10.42.42.10(pid=8929): Launched 04:32:35.609465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:32:35.826196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:32:36.150328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8930): Launched 04:32:36.429778 run iperf3-srv_10.42.42.10(pid=8931): Launched 04:32:36.550682 tst iperf3m4.py:8: start network... 04:32:36.766867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:37.268382 run create_hlr_db(pid=8932): Launched 04:32:37.391320 bus /gobi_6: Setting Powered False 04:32:38.454952 run create_hlr_db(pid=8932): Terminated: ok {rc=0} 04:32:38.902909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8934): Launched 04:32:39.225070 run osmo-hlr_10.42.42.2(pid=8935): Launched 04:32:39.347373 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:39.903921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8937): Launched 04:32:40.225688 run osmo-stp_10.42.42.5(pid=8938): Launched 04:32:40.350152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:40.908153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8940): Launched 04:32:41.030767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:41.302065 run patchelf(pid=8941): Launched 04:32:41.481605 run osmo-stp_10.42.42.5(pid=8938): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8938)] 04:32:41.617956 run osmo-stp_10.42.42.5(pid=8938): stdout: | (launched: 2022-12-14_04:32:40.166295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:41.755401 run osmo-stp_10.42.42.5(pid=8938): stderr: | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043240355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:41.893954 run osmo-stp_10.42.42.5(pid=8938): stdout: | (launched: 2022-12-14_04:32:40.166295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:42.025705 run osmo-stp_10.42.42.5(pid=8938): stderr: | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043240354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043240355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043240355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:42.181984 run patchelf(pid=8941): Terminating (SIGINT) 04:32:42.361059 run patchelf(pid=8941): Terminated: ok {rc=0} 04:32:42.490178 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8938): Process ended prematurely: osmo-stp_10.42.42.5(pid=8938) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8938)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 04:32:42.500604 tst iperf3m4.py:8: Test FAILED (11.0 sec) 04:32:42.529287 run osmo-hlr_10.42.42.2(pid=8935): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8935)] 04:32:42.580267 run osmo-hlr_10.42.42.2(pid=8935): stdout: | (launched: 2022-12-14_04:32:39.165220) 04:32:42.632517 run osmo-hlr_10.42.42.2(pid=8935): stderr: | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043239361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043239374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043239382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043239382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043239382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:42.685069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Terminating (SIGTERM) 04:32:42.726724 run iperf3-srv_10.42.42.10(pid=8925): Terminating (SIGTERM) 04:32:42.768724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8926): Terminating (SIGTERM) 04:32:42.811139 run iperf3-srv_10.42.42.10(pid=8927): Terminating (SIGTERM) 04:32:42.853390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Terminating (SIGTERM) 04:32:42.895497 run iperf3-srv_10.42.42.10(pid=8929): Terminating (SIGTERM) 04:32:42.937456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8930): Terminating (SIGTERM) 04:32:42.979620 run iperf3-srv_10.42.42.10(pid=8931): Terminating (SIGTERM) 04:32:43.021774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8934): Terminating (SIGTERM) 04:32:43.063850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8937): Terminating (SIGTERM) 04:32:43.106234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8940): Terminating (SIGTERM) 04:32:43.149463 --- ParallelTerminationStrategy: PID 8924 died... 04:32:43.170035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Terminated: ok {rc=0} 04:32:43.216787 --- ParallelTerminationStrategy: PID 8925 died... 04:32:43.237033 run iperf3-srv_10.42.42.10(pid=8925): Terminated {rc=256} 04:32:43.283210 --- ParallelTerminationStrategy: PID 8926 died... 04:32:43.303014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8926): Terminated: ok {rc=0} 04:32:43.349220 --- ParallelTerminationStrategy: PID 8927 died... 04:32:43.368840 run iperf3-srv_10.42.42.10(pid=8927): Terminated {rc=256} 04:32:43.414885 --- ParallelTerminationStrategy: PID 8928 died... 04:32:43.434821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8928): Terminated: ok {rc=0} 04:32:43.480904 --- ParallelTerminationStrategy: PID 8929 died... 04:32:43.500784 run iperf3-srv_10.42.42.10(pid=8929): Terminated {rc=256} 04:32:43.546952 --- ParallelTerminationStrategy: PID 8930 died... 04:32:43.566890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8930): Terminated: ok {rc=0} 04:32:43.613162 --- ParallelTerminationStrategy: PID 8931 died... 04:32:43.632798 run iperf3-srv_10.42.42.10(pid=8931): Terminated {rc=256} 04:32:43.679021 --- ParallelTerminationStrategy: PID 8934 died... 04:32:43.698809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8934): Terminated: ok {rc=0} 04:32:43.745129 --- ParallelTerminationStrategy: PID 8937 died... 04:32:43.764908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8937): Terminated: ok {rc=0} 04:32:43.811812 --- ParallelTerminationStrategy: PID 8940 died... 04:32:43.832012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8940): Terminated: ok {rc=0} 04:32:43.922312 bus /gobi_4: Setting Powered False 04:32:45.023735 bus /gobi_4: Setting Powered False 04:32:46.144055 bus /gobi_1: Setting Powered False 04:32:47.247903 bus /gobi_1: Setting Powered False 04:32:48.367683 bus /gobi_0: Setting Powered False 04:32:49.469453 bus /gobi_0: Setting Powered False 04:32:50.591383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 04:32:51.698471 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:51.710848 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:51.757468 tst ping.py: using LAC 38570 04:32:51.881768 tst ping.py: using RAC 65 04:32:52.005382 tst ping.py: using CellId 38570 04:32:52.126717 tst ping.py: using BVCI 38571 04:32:52.241331 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.252826 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.264217 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.275468 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.287059 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.298580 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.310366 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:52.321955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:32:52.438922 tst ping.py:19: start network... 04:32:52.634364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:32:53.090284 run create_hlr_db(pid=8942): Launched 04:32:53.209755 bus /gobi_6: Setting Powered False 04:32:54.268657 run create_hlr_db(pid=8942): Terminated: ok {rc=0} 04:32:54.699105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Launched 04:32:55.015621 run osmo-hlr_10.42.42.2(pid=8945): Launched 04:32:55.136671 run osmo-stp_10.42.42.5: Starting osmo-stp 04:32:55.683592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Launched 04:32:55.999435 run osmo-stp_10.42.42.5(pid=8948): Launched 04:32:56.122503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:32:56.670658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Launched 04:32:56.792748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:32:57.061687 run patchelf(pid=8951): Launched 04:32:57.240659 run osmo-stp_10.42.42.5(pid=8948): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] 04:32:57.374434 run osmo-stp_10.42.42.5(pid=8948): stdout: | (launched: 2022-12-14_04:32:55.941281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:57.510532 run osmo-stp_10.42.42.5(pid=8948): stderr: | [0;m[38;5;43m20221214043256129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043256129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043256130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043256130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:57.646708 run osmo-stp_10.42.42.5(pid=8948): stdout: | (launched: 2022-12-14_04:32:55.941281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:32:57.776487 run osmo-stp_10.42.42.5(pid=8948): stderr: | [0;m[38;5;43m20221214043256129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043256129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043256130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043256130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043256131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:32:57.930579 run patchelf(pid=8951): Terminating (SIGINT) 04:32:58.107157 run patchelf(pid=8951): Terminated: ok {rc=0} 04:32:58.234298 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8948): Process ended prematurely: osmo-stp_10.42.42.5(pid=8948) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 04:32:58.243927 tst ping.py:22: Test FAILED (6.5 sec) 04:32:58.272193 run osmo-hlr_10.42.42.2(pid=8945): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8945)] 04:32:58.323665 run osmo-hlr_10.42.42.2(pid=8945): stdout: | (launched: 2022-12-14_04:32:54.957433) 04:32:58.376161 run osmo-hlr_10.42.42.2(pid=8945): stderr: | [0;m[1;31m20221214043255151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043255151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043255151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043255152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043255152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043255152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043255163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043255172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043255172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043255172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:32:58.429310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Terminating (SIGTERM) 04:32:58.471229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Terminating (SIGTERM) 04:32:58.513693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Terminating (SIGTERM) 04:32:58.556410 --- ParallelTerminationStrategy: PID 8944 died... 04:32:58.577086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8944): Terminated: ok {rc=0} 04:32:58.623811 --- ParallelTerminationStrategy: PID 8947 died... 04:32:58.643778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8947): Terminated: ok {rc=0} 04:32:58.691013 --- ParallelTerminationStrategy: PID 8950 died... 04:32:58.711002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8950): Terminated: ok {rc=0} 04:32:58.799618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:32:59.886378 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:32:59.898755 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:32:59.947649 tst ping_idle_ping.py: using LAC 38571 04:33:00.064862 tst ping_idle_ping.py: using RAC 66 04:33:00.179544 tst ping_idle_ping.py: using CellId 38571 04:33:00.295949 tst ping_idle_ping.py: using BVCI 38572 04:33:00.402336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.413455 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.424271 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.435133 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.445932 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.456585 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.467553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:33:00.478449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:33:00.596845 tst ping_idle_ping.py:24: start network... 04:33:00.809547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:01.330644 run create_hlr_db(pid=8953): Launched 04:33:01.474335 bus /gobi_6: Setting Powered False 04:33:02.534076 run create_hlr_db(pid=8953): Terminated: ok {rc=0} 04:33:02.967373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Launched 04:33:03.283059 run osmo-hlr_10.42.42.2(pid=8956): Launched 04:33:03.404994 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:03.949406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Launched 04:33:04.266899 run osmo-stp_10.42.42.5(pid=8959): Launched 04:33:04.386549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:04.932254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Launched 04:33:05.053575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:05.320800 run patchelf(pid=8962): Launched 04:33:05.497667 run osmo-stp_10.42.42.5(pid=8959): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] 04:33:05.631582 run osmo-stp_10.42.42.5(pid=8959): stdout: | (launched: 2022-12-14_04:33:04.208214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:05.767822 run osmo-stp_10.42.42.5(pid=8959): stderr: | [0;m[38;5;43m20221214043304397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043304397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043304398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043304398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:05.904506 run osmo-stp_10.42.42.5(pid=8959): stdout: | (launched: 2022-12-14_04:33:04.208214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:06.034439 run osmo-stp_10.42.42.5(pid=8959): stderr: | [0;m[38;5;43m20221214043304397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043304397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043304398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043304398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043304399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:06.187809 run patchelf(pid=8962): Terminating (SIGINT) 04:33:06.364280 run patchelf(pid=8962): Terminated: ok {rc=0} 04:33:06.492264 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8959): Process ended prematurely: osmo-stp_10.42.42.5(pid=8959) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 04:33:06.502143 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 04:33:06.530361 run osmo-hlr_10.42.42.2(pid=8956): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8956)] 04:33:06.581525 run osmo-hlr_10.42.42.2(pid=8956): stdout: | (launched: 2022-12-14_04:33:03.224922) 04:33:06.634066 run osmo-hlr_10.42.42.2(pid=8956): stderr: | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043303419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043303431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043303440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043303440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043303440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:06.686919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Terminating (SIGTERM) 04:33:06.728719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Terminating (SIGTERM) 04:33:06.770980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Terminating (SIGTERM) 04:33:06.813841 --- ParallelTerminationStrategy: PID 8955 died... 04:33:06.834040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Terminated: ok {rc=0} 04:33:06.880597 --- ParallelTerminationStrategy: PID 8958 died... 04:33:06.900511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Terminated: ok {rc=0} 04:33:06.946704 --- ParallelTerminationStrategy: PID 8961 died... 04:33:06.966546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Terminated: ok {rc=0} 04:33:07.055204 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:33:08.354857 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:33:08.360730 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:33:08.389537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:33:08.427892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:33:08.514369 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:33:08.543166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:33:08.581459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:33:09.178945 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:33:09.227158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.238276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:09.303770 tst cs_paging_gprs_active.py: using LAC 38572 04:33:09.423135 tst cs_paging_gprs_active.py: using RAC 67 04:33:09.540704 tst cs_paging_gprs_active.py: using CellId 38572 04:33:09.667022 tst cs_paging_gprs_active.py: using BVCI 38573 04:33:09.784646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.796608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.807969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.819671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.831397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.843091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.854859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.866540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:09.878281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:09.996156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:10.116677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:33:10.333229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:10.656347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8967): Launched 04:33:10.937979 run iperf3-srv_10.42.42.10(pid=8968): Launched 04:33:11.058159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:33:11.274691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:11.598288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8969): Launched 04:33:11.879305 run iperf3-srv_10.42.42.10(pid=8970): Launched 04:33:12.001371 tst cs_paging_gprs_active.py:38: start network... 04:33:12.217699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:12.718111 run create_hlr_db(pid=8971): Launched 04:33:12.842953 bus /gobi_6: Setting Powered False 04:33:13.906926 run create_hlr_db(pid=8971): Terminated: ok {rc=0} 04:33:14.336606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8973): Launched 04:33:14.660856 run osmo-hlr_10.42.42.2(pid=8974): Launched 04:33:14.783554 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:15.339200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8976): Launched 04:33:15.661989 run osmo-stp_10.42.42.5(pid=8977): Launched 04:33:15.786254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:16.415460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8979): Launched 04:33:16.551332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:16.829296 run patchelf(pid=8980): Launched 04:33:17.023435 run osmo-stp_10.42.42.5(pid=8977): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8977)] 04:33:17.164076 run osmo-stp_10.42.42.5(pid=8977): stdout: | (launched: 2022-12-14_04:33:15.602271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:17.304554 run osmo-stp_10.42.42.5(pid=8977): stderr: | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043315794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:17.443182 run osmo-stp_10.42.42.5(pid=8977): stdout: | (launched: 2022-12-14_04:33:15.602271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:17.576235 run osmo-stp_10.42.42.5(pid=8977): stderr: | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043315793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043315794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043315794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:17.733552 run patchelf(pid=8980): Terminating (SIGINT) 04:33:17.915127 run patchelf(pid=8980): Terminated: ok {rc=0} 04:33:18.045955 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8977): Process ended prematurely: osmo-stp_10.42.42.5(pid=8977) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8977)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:33:18.056297 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:33:18.085483 run osmo-hlr_10.42.42.2(pid=8974): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8974)] 04:33:18.137329 run osmo-hlr_10.42.42.2(pid=8974): stdout: | (launched: 2022-12-14_04:33:14.601199) 04:33:18.189978 run osmo-hlr_10.42.42.2(pid=8974): stderr: | [0;m[1;31m20221214043314799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043314799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043314799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043314799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043314800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043314800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043314811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043314819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043314820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043314820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:18.243325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8967): Terminating (SIGTERM) 04:33:18.285361 run iperf3-srv_10.42.42.10(pid=8968): Terminating (SIGTERM) 04:33:18.327840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8969): Terminating (SIGTERM) 04:33:18.370305 run iperf3-srv_10.42.42.10(pid=8970): Terminating (SIGTERM) 04:33:18.412693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8973): Terminating (SIGTERM) 04:33:18.455109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8976): Terminating (SIGTERM) 04:33:18.497452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8979): Terminating (SIGTERM) 04:33:18.539897 --- ParallelTerminationStrategy: PID 8967 died... 04:33:18.560379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8967): Terminated: ok {rc=0} 04:33:18.607136 --- ParallelTerminationStrategy: PID 8968 died... 04:33:18.627065 run iperf3-srv_10.42.42.10(pid=8968): Terminated {rc=256} 04:33:18.673515 --- ParallelTerminationStrategy: PID 8969 died... 04:33:18.693452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8969): Terminated: ok {rc=0} 04:33:18.739876 --- ParallelTerminationStrategy: PID 8970 died... 04:33:18.759743 run iperf3-srv_10.42.42.10(pid=8970): Terminated {rc=256} 04:33:18.806254 --- ParallelTerminationStrategy: PID 8973 died... 04:33:18.826581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8973): Terminated: ok {rc=0} 04:33:18.873282 --- ParallelTerminationStrategy: PID 8976 died... 04:33:18.893251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8976): Terminated: ok {rc=0} 04:33:18.939824 --- ParallelTerminationStrategy: PID 8979 died... 04:33:18.959788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8979): Terminated: ok {rc=0} 04:33:19.047362 bus /gobi_0: Setting Powered False 04:33:20.146185 bus /gobi_0: Setting Powered False 04:33:21.264554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:33:22.410420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:22.422437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:22.490876 tst iperf3.py: using LAC 38573 04:33:22.614791 tst iperf3.py: using RAC 68 04:33:22.731436 tst iperf3.py: using CellId 38573 04:33:22.857342 tst iperf3.py: using BVCI 38574 04:33:22.974209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:22.986006 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:22.997967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.009567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.021169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.033008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.044727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.056369 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:23.068272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:23.184588 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:23.384759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:23.684795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8981): Launched 04:33:23.946968 run iperf3-srv_10.42.42.10(pid=8982): Launched 04:33:24.060440 tst iperf3.py:8: start network... 04:33:24.259933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:24.724145 run create_hlr_db(pid=8983): Launched 04:33:24.847376 bus /gobi_6: Setting Powered False 04:33:25.907443 run create_hlr_db(pid=8983): Terminated: ok {rc=0} 04:33:26.345328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8985): Launched 04:33:26.667474 run osmo-hlr_10.42.42.2(pid=8986): Launched 04:33:26.790458 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:27.352835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8988): Launched 04:33:27.674035 run osmo-stp_10.42.42.5(pid=8989): Launched 04:33:27.797570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:28.355578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8991): Launched 04:33:28.479350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:28.750929 run patchelf(pid=8992): Launched 04:33:28.930169 run osmo-stp_10.42.42.5(pid=8989): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8989)] 04:33:29.066046 run osmo-stp_10.42.42.5(pid=8989): stdout: | (launched: 2022-12-14_04:33:27.614743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:29.203704 run osmo-stp_10.42.42.5(pid=8989): stderr: | [0;m[38;5;43m20221214043327806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043327806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043327807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043327807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043327807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043327807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043327808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:29.341185 run osmo-stp_10.42.42.5(pid=8989): stdout: | (launched: 2022-12-14_04:33:27.614743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:29.473069 run osmo-stp_10.42.42.5(pid=8989): stderr: | [0;m[38;5;43m20221214043327806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043327806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043327807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043327807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043327807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043327807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043327808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:29.629406 run patchelf(pid=8992): Terminating (SIGINT) 04:33:29.808487 run patchelf(pid=8992): Terminated: ok {rc=0} 04:33:29.939359 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8989): Process ended prematurely: osmo-stp_10.42.42.5(pid=8989) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8989)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 04:33:29.949776 tst iperf3.py:8: Test FAILED (7.6 sec) 04:33:29.978383 run osmo-hlr_10.42.42.2(pid=8986): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8986)] 04:33:30.029526 run osmo-hlr_10.42.42.2(pid=8986): stdout: | (launched: 2022-12-14_04:33:26.608105) 04:33:30.081541 run osmo-hlr_10.42.42.2(pid=8986): stderr: | [0;m[1;31m20221214043326804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043326804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043326805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043326805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043326805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043326805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043326818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043326828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043326828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043326828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:30.134404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8981): Terminating (SIGTERM) 04:33:30.176031 run iperf3-srv_10.42.42.10(pid=8982): Terminating (SIGTERM) 04:33:30.218179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8985): Terminating (SIGTERM) 04:33:30.260127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8988): Terminating (SIGTERM) 04:33:30.302194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8991): Terminating (SIGTERM) 04:33:30.344426 --- ParallelTerminationStrategy: PID 8981 died... 04:33:30.364860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8981): Terminated: ok {rc=0} 04:33:30.411059 --- ParallelTerminationStrategy: PID 8982 died... 04:33:30.430757 run iperf3-srv_10.42.42.10(pid=8982): Terminated {rc=256} 04:33:30.476700 --- ParallelTerminationStrategy: PID 8985 died... 04:33:30.496611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8985): Terminated: ok {rc=0} 04:33:30.542687 --- ParallelTerminationStrategy: PID 8988 died... 04:33:30.562531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8988): Terminated: ok {rc=0} 04:33:30.609069 --- ParallelTerminationStrategy: PID 8991 died... 04:33:30.628780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8991): Terminated: ok {rc=0} 04:33:30.716897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:33:31.899403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:31.915581 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:31.990670 tst iperf3m4.py: using LAC 38574 04:33:32.137456 tst iperf3m4.py: using RAC 69 04:33:32.267408 tst iperf3m4.py: using CellId 38574 04:33:32.388884 tst iperf3m4.py: using BVCI 38575 04:33:32.508584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.520219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.531744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.543231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.555638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.567804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.580219 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.592160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:32.604382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:32.726169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:32.844899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:32.965191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:33.080535 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:33:33.280906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:33.582022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Launched 04:33:33.846515 run iperf3-srv_10.42.42.10(pid=8995): Launched 04:33:33.961993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:33:34.162555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:34.464652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Launched 04:33:34.727390 run iperf3-srv_10.42.42.10(pid=8997): Launched 04:33:34.840430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:33:35.041228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:35.343321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Launched 04:33:35.605659 run iperf3-srv_10.42.42.10(pid=8999): Launched 04:33:35.718445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:33:35.917974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:33:36.221304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9000): Launched 04:33:36.482859 run iperf3-srv_10.42.42.10(pid=9001): Launched 04:33:36.595034 tst iperf3m4.py:8: start network... 04:33:36.794194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:37.260720 run create_hlr_db(pid=9002): Launched 04:33:37.386961 bus /gobi_6: Setting Powered False 04:33:38.450482 run create_hlr_db(pid=9002): Terminated: ok {rc=0} 04:33:38.880132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9004): Launched 04:33:39.179978 run osmo-hlr_10.42.42.2(pid=9005): Launched 04:33:39.293596 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:39.811948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9007): Launched 04:33:40.126719 run osmo-stp_10.42.42.5(pid=9008): Launched 04:33:40.251392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:40.807446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9010): Launched 04:33:40.932108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:41.204542 run patchelf(pid=9011): Launched 04:33:41.384584 run osmo-stp_10.42.42.5(pid=9008): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9008)] 04:33:41.520530 run osmo-stp_10.42.42.5(pid=9008): stdout: | (launched: 2022-12-14_04:33:40.067298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:41.658389 run osmo-stp_10.42.42.5(pid=9008): stderr: | [0;m[38;5;43m20221214043340254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043340254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043340255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043340255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:41.795751 run osmo-stp_10.42.42.5(pid=9008): stdout: | (launched: 2022-12-14_04:33:40.067298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:41.928175 run osmo-stp_10.42.42.5(pid=9008): stderr: | [0;m[38;5;43m20221214043340254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043340254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043340255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043340255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043340256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:42.085012 run patchelf(pid=9011): Terminating (SIGINT) 04:33:42.264706 run patchelf(pid=9011): Terminated: ok {rc=0} 04:33:42.394033 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9008): Process ended prematurely: osmo-stp_10.42.42.5(pid=9008) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9008)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:33:42.404452 tst iperf3m4.py:8: Test FAILED (10.6 sec) 04:33:42.433406 run osmo-hlr_10.42.42.2(pid=9005): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9005)] 04:33:42.484145 run osmo-hlr_10.42.42.2(pid=9005): stdout: | (launched: 2022-12-14_04:33:39.123733) 04:33:42.536183 run osmo-hlr_10.42.42.2(pid=9005): stderr: | [0;m[1;31m20221214043339297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043339297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043339297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043339297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043339298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043339298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043339310 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043339319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043339319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043339319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:42.588601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Terminating (SIGTERM) 04:33:42.630625 run iperf3-srv_10.42.42.10(pid=8995): Terminating (SIGTERM) 04:33:42.672382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Terminating (SIGTERM) 04:33:42.714157 run iperf3-srv_10.42.42.10(pid=8997): Terminating (SIGTERM) 04:33:42.755736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Terminating (SIGTERM) 04:33:42.797442 run iperf3-srv_10.42.42.10(pid=8999): Terminating (SIGTERM) 04:33:42.839414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9000): Terminating (SIGTERM) 04:33:42.881286 run iperf3-srv_10.42.42.10(pid=9001): Terminating (SIGTERM) 04:33:42.922829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9004): Terminating (SIGTERM) 04:33:42.964603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9007): Terminating (SIGTERM) 04:33:43.006563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9010): Terminating (SIGTERM) 04:33:43.048535 --- ParallelTerminationStrategy: PID 8994 died... 04:33:43.068724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Terminated: ok {rc=0} 04:33:43.114958 --- ParallelTerminationStrategy: PID 8995 died... 04:33:43.134596 run iperf3-srv_10.42.42.10(pid=8995): Terminated {rc=256} 04:33:43.180565 --- ParallelTerminationStrategy: PID 8996 died... 04:33:43.200269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Terminated: ok {rc=0} 04:33:43.246342 --- ParallelTerminationStrategy: PID 8997 died... 04:33:43.266191 run iperf3-srv_10.42.42.10(pid=8997): Terminated {rc=256} 04:33:43.312436 --- ParallelTerminationStrategy: PID 8998 died... 04:33:43.332250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Terminated: ok {rc=0} 04:33:43.378622 --- ParallelTerminationStrategy: PID 8999 died... 04:33:43.398467 run iperf3-srv_10.42.42.10(pid=8999): Terminated {rc=256} 04:33:43.444816 --- ParallelTerminationStrategy: PID 9000 died... 04:33:43.465155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9000): Terminated: ok {rc=0} 04:33:43.511717 --- ParallelTerminationStrategy: PID 9001 died... 04:33:43.531554 run iperf3-srv_10.42.42.10(pid=9001): Terminated {rc=256} 04:33:43.577953 --- ParallelTerminationStrategy: PID 9004 died... 04:33:43.597792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9004): Terminated: ok {rc=0} 04:33:43.643933 --- ParallelTerminationStrategy: PID 9007 died... 04:33:43.663765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9007): Terminated: ok {rc=0} 04:33:43.710150 --- ParallelTerminationStrategy: PID 9010 died... 04:33:43.730131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9010): Terminated: ok {rc=0} 04:33:43.819107 bus /gobi_4: Setting Powered False 04:33:44.919921 bus /gobi_4: Setting Powered False 04:33:46.052459 bus /gobi_1: Setting Powered False 04:33:47.148326 bus /gobi_1: Setting Powered False 04:33:48.262723 bus /gobi_0: Setting Powered False 04:33:49.361683 bus /gobi_0: Setting Powered False 04:33:50.480219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:33:51.583948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:51.596263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:51.664311 tst ping.py: using LAC 38575 04:33:51.788635 tst ping.py: using RAC 70 04:33:51.904619 tst ping.py: using CellId 38575 04:33:52.019852 tst ping.py: using BVCI 38576 04:33:52.127036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.138363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.149313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.160146 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.171015 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.181901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.192783 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:52.203661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:33:52.321334 tst ping.py:19: start network... 04:33:52.534289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:33:53.023559 run create_hlr_db(pid=9012): Launched 04:33:53.143759 bus /gobi_6: Setting Powered False 04:33:54.207435 run create_hlr_db(pid=9012): Terminated: ok {rc=0} 04:33:54.631209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9014): Launched 04:33:54.925212 run osmo-hlr_10.42.42.2(pid=9015): Launched 04:33:55.036591 run osmo-stp_10.42.42.5: Starting osmo-stp 04:33:55.561627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9017): Launched 04:33:55.856576 run osmo-stp_10.42.42.5(pid=9018): Launched 04:33:55.967748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:33:56.477381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9020): Launched 04:33:56.590295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:33:56.840607 run patchelf(pid=9021): Launched 04:33:57.003891 run osmo-stp_10.42.42.5(pid=9018): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9018)] 04:33:57.128597 run osmo-stp_10.42.42.5(pid=9018): stdout: | (launched: 2022-12-14_04:33:55.801716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:57.255409 run osmo-stp_10.42.42.5(pid=9018): stderr: | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043355969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043355969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043355969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043355970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:57.382111 run osmo-stp_10.42.42.5(pid=9018): stdout: | (launched: 2022-12-14_04:33:55.801716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:33:57.503081 run osmo-stp_10.42.42.5(pid=9018): stderr: | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043355968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043355969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043355969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043355969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043355970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:33:57.646725 run patchelf(pid=9021): Terminating (SIGINT) 04:33:57.812278 run patchelf(pid=9021): Terminated: ok {rc=0} 04:33:57.931223 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9018): Process ended prematurely: osmo-stp_10.42.42.5(pid=9018) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9018)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 04:33:57.939992 tst ping.py:22: Test FAILED (6.3 sec) 04:33:57.967037 run osmo-hlr_10.42.42.2(pid=9015): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9015)] 04:33:58.015240 run osmo-hlr_10.42.42.2(pid=9015): stdout: | (launched: 2022-12-14_04:33:54.870570) 04:33:58.065422 run osmo-hlr_10.42.42.2(pid=9015): stderr: | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043355047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043355060 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043355070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043355070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043355070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:33:58.115218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9014): Terminating (SIGTERM) 04:33:58.155317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9017): Terminating (SIGTERM) 04:33:58.195235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9020): Terminating (SIGTERM) 04:33:58.235115 --- ParallelTerminationStrategy: PID 9014 died... 04:33:58.254487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9014): Terminated: ok {rc=0} 04:33:58.298648 --- ParallelTerminationStrategy: PID 9017 died... 04:33:58.317460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9017): Terminated: ok {rc=0} 04:33:58.361142 --- ParallelTerminationStrategy: PID 9020 died... 04:33:58.379846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9020): Terminated: ok {rc=0} 04:33:58.462733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:33:59.548265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:33:59.560704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:33:59.630722 tst ping_idle_ping.py: using LAC 38576 04:33:59.755885 tst ping_idle_ping.py: using RAC 71 04:33:59.880502 tst ping_idle_ping.py: using CellId 38576 04:34:00.005201 tst ping_idle_ping.py: using BVCI 38577 04:34:00.121610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.133197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.144697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.156199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.167836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.179629 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.191453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:34:00.203311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:34:00.318702 tst ping_idle_ping.py:24: start network... 04:34:00.515561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:01.017825 run create_hlr_db(pid=9022): Launched 04:34:01.165881 bus /gobi_6: Setting Powered False 04:34:02.225399 run create_hlr_db(pid=9022): Terminated: ok {rc=0} 04:34:02.643047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9024): Launched 04:34:02.942355 run osmo-hlr_10.42.42.2(pid=9025): Launched 04:34:03.056210 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:03.566791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9027): Launched 04:34:03.862097 run osmo-stp_10.42.42.5(pid=9028): Launched 04:34:03.973284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:04.483022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9030): Launched 04:34:04.595477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:04.845166 run patchelf(pid=9031): Launched 04:34:05.008757 run osmo-stp_10.42.42.5(pid=9028): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9028)] 04:34:05.133901 run osmo-stp_10.42.42.5(pid=9028): stdout: | (launched: 2022-12-14_04:34:03.806330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:05.260719 run osmo-stp_10.42.42.5(pid=9028): stderr: | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043403977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:05.387465 run osmo-stp_10.42.42.5(pid=9028): stdout: | (launched: 2022-12-14_04:34:03.806330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:05.507982 run osmo-stp_10.42.42.5(pid=9028): stderr: | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043403976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043403977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:05.651099 run patchelf(pid=9031): Terminating (SIGINT) 04:34:05.816388 run patchelf(pid=9031): Terminated: ok {rc=0} 04:34:05.935459 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9028): Process ended prematurely: osmo-stp_10.42.42.5(pid=9028) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9028)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:34:05.944937 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:34:05.971470 run osmo-hlr_10.42.42.2(pid=9025): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9025)] 04:34:06.018883 run osmo-hlr_10.42.42.2(pid=9025): stdout: | (launched: 2022-12-14_04:34:02.887243) 04:34:06.067714 run osmo-hlr_10.42.42.2(pid=9025): stderr: | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043403063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043403076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043403085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043403085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043403085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:06.117393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9024): Terminating (SIGTERM) 04:34:06.156785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9027): Terminating (SIGTERM) 04:34:06.196570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9030): Terminating (SIGTERM) 04:34:06.236590 --- ParallelTerminationStrategy: PID 9024 died... 04:34:06.255689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9024): Terminated: ok {rc=0} 04:34:06.299186 --- ParallelTerminationStrategy: PID 9027 died... 04:34:06.317766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9027): Terminated: ok {rc=0} 04:34:06.361013 --- ParallelTerminationStrategy: PID 9030 died... 04:34:06.379493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9030): Terminated: ok {rc=0} 04:34:06.464294 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 04:34:07.765148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:34:07.771535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 04:34:07.801352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 04:34:07.841348 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 04:34:07.929973 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 04:34:07.958383 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 04:34:07.996741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 04:34:08.598703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 04:34:08.652017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:08.663724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:08.732117 tst cs_paging_gprs_active.py: using LAC 38577 04:34:08.858806 tst cs_paging_gprs_active.py: using RAC 72 04:34:08.987224 tst cs_paging_gprs_active.py: using CellId 38577 04:34:09.108695 tst cs_paging_gprs_active.py: using BVCI 38578 04:34:09.218109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.229147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.239855 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.250949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.262378 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.273712 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.285172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.296451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:09.308077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:09.430567 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:09.548609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:34:09.750638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:10.052909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9036): Launched 04:34:10.315946 run iperf3-srv_10.42.42.10(pid=9037): Launched 04:34:10.428427 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:34:10.629149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:10.931317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9038): Launched 04:34:11.194411 run iperf3-srv_10.42.42.10(pid=9039): Launched 04:34:11.306943 tst cs_paging_gprs_active.py:38: start network... 04:34:11.507622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:11.973744 run create_hlr_db(pid=9040): Launched 04:34:12.096116 bus /gobi_6: Setting Powered False 04:34:13.156932 run create_hlr_db(pid=9040): Terminated: ok {rc=0} 04:34:13.598307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9042): Launched 04:34:13.921924 run osmo-hlr_10.42.42.2(pid=9043): Launched 04:34:14.046496 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:14.606508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9045): Launched 04:34:14.931533 run osmo-stp_10.42.42.5(pid=9046): Launched 04:34:15.055027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:15.612108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9048): Launched 04:34:15.737509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:16.065947 run patchelf(pid=9049): Launched 04:34:16.292483 run osmo-stp_10.42.42.5(pid=9046): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9046)] 04:34:16.434414 run osmo-stp_10.42.42.5(pid=9046): stdout: | (launched: 2022-12-14_04:34:14.871780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:16.577665 run osmo-stp_10.42.42.5(pid=9046): stderr: | [0;m[38;5;43m20221214043415063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043415063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043415064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043415064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043415064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043415064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043415065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:16.720855 run osmo-stp_10.42.42.5(pid=9046): stdout: | (launched: 2022-12-14_04:34:14.871780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:16.858378 run osmo-stp_10.42.42.5(pid=9046): stderr: | [0;m[38;5;43m20221214043415063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043415063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043415064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043415064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043415064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043415064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043415065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:17.020495 run patchelf(pid=9049): Terminating (SIGINT) 04:34:17.207494 run patchelf(pid=9049): Terminated: ok {rc=0} 04:34:17.339391 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9046): Process ended prematurely: osmo-stp_10.42.42.5(pid=9046) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9046)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 04:34:17.350176 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:34:17.379725 run osmo-hlr_10.42.42.2(pid=9043): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9043)] 04:34:17.432243 run osmo-hlr_10.42.42.2(pid=9043): stdout: | (launched: 2022-12-14_04:34:13.862099) 04:34:17.485554 run osmo-hlr_10.42.42.2(pid=9043): stderr: | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043414059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043414071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043414080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043414080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043414080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:17.539562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9036): Terminating (SIGTERM) 04:34:17.582007 run iperf3-srv_10.42.42.10(pid=9037): Terminating (SIGTERM) 04:34:17.624815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9038): Terminating (SIGTERM) 04:34:17.667760 run iperf3-srv_10.42.42.10(pid=9039): Terminating (SIGTERM) 04:34:17.710739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9042): Terminating (SIGTERM) 04:34:17.753641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9045): Terminating (SIGTERM) 04:34:17.796407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9048): Terminating (SIGTERM) 04:34:17.839595 --- ParallelTerminationStrategy: PID 9036 died... 04:34:17.860261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9036): Terminated: ok {rc=0} 04:34:17.907686 --- ParallelTerminationStrategy: PID 9037 died... 04:34:17.927517 run iperf3-srv_10.42.42.10(pid=9037): Terminated {rc=256} 04:34:17.974617 --- ParallelTerminationStrategy: PID 9038 died... 04:34:17.994771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9038): Terminated: ok {rc=0} 04:34:18.041795 --- ParallelTerminationStrategy: PID 9039 died... 04:34:18.061908 run iperf3-srv_10.42.42.10(pid=9039): Terminated {rc=256} 04:34:18.109055 --- ParallelTerminationStrategy: PID 9042 died... 04:34:18.129259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9042): Terminated: ok {rc=0} 04:34:18.176202 --- ParallelTerminationStrategy: PID 9045 died... 04:34:18.196528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9045): Terminated: ok {rc=0} 04:34:18.243850 --- ParallelTerminationStrategy: PID 9048 died... 04:34:18.264159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9048): Terminated: ok {rc=0} 04:34:18.354377 bus /gobi_0: Setting Powered False 04:34:19.451524 bus /gobi_0: Setting Powered False 04:34:20.566938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 04:34:21.716422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:21.728768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:21.797877 tst iperf3.py: using LAC 38578 04:34:21.926771 tst iperf3.py: using RAC 73 04:34:22.054914 tst iperf3.py: using CellId 38578 04:34:22.182647 tst iperf3.py: using BVCI 38579 04:34:22.299974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.311605 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.323125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.334456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.346182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.357920 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.369755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.381311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:22.393047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:22.511279 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:34:22.728243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:23.051358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9050): Launched 04:34:23.333423 run iperf3-srv_10.42.42.10(pid=9051): Launched 04:34:23.456228 tst iperf3.py:8: start network... 04:34:23.673359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:24.174480 run create_hlr_db(pid=9052): Launched 04:34:24.297040 bus /gobi_6: Setting Powered False 04:34:25.361258 run create_hlr_db(pid=9052): Terminated: ok {rc=0} 04:34:25.790407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Launched 04:34:26.091702 run osmo-hlr_10.42.42.2(pid=9055): Launched 04:34:26.208744 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:26.744534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Launched 04:34:27.047095 run osmo-stp_10.42.42.5(pid=9058): Launched 04:34:27.161232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:27.681359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Launched 04:34:27.796015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:28.051703 run patchelf(pid=9061): Launched 04:34:28.219025 run osmo-stp_10.42.42.5(pid=9058): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] 04:34:28.346686 run osmo-stp_10.42.42.5(pid=9058): stdout: | (launched: 2022-12-14_04:34:26.989965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:28.476033 run osmo-stp_10.42.42.5(pid=9058): stderr: | [0;m[38;5;43m20221214043427158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043427159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043427159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043427159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:28.604598 run osmo-stp_10.42.42.5(pid=9058): stdout: | (launched: 2022-12-14_04:34:26.989965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:28.727727 run osmo-stp_10.42.42.5(pid=9058): stderr: | [0;m[38;5;43m20221214043427158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043427159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043427159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043427159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043427160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:28.873666 run patchelf(pid=9061): Terminating (SIGINT) 04:34:29.041594 run patchelf(pid=9061): Terminated: ok {rc=0} 04:34:29.162775 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9058): Process ended prematurely: osmo-stp_10.42.42.5(pid=9058) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 04:34:29.172325 tst iperf3.py:8: Test FAILED (7.5 sec) 04:34:29.199508 run osmo-hlr_10.42.42.2(pid=9055): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9055)] 04:34:29.247656 run osmo-hlr_10.42.42.2(pid=9055): stdout: | (launched: 2022-12-14_04:34:26.035781) 04:34:29.297453 run osmo-hlr_10.42.42.2(pid=9055): stderr: | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043426211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043426224 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043426234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043426234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043426234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:29.347288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9050): Terminating (SIGTERM) 04:34:29.387651 run iperf3-srv_10.42.42.10(pid=9051): Terminating (SIGTERM) 04:34:29.427488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Terminating (SIGTERM) 04:34:29.467706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Terminating (SIGTERM) 04:34:29.507399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Terminating (SIGTERM) 04:34:29.547777 --- ParallelTerminationStrategy: PID 9050 died... 04:34:29.566769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9050): Terminated: ok {rc=0} 04:34:29.610480 --- ParallelTerminationStrategy: PID 9051 died... 04:34:29.628998 run iperf3-srv_10.42.42.10(pid=9051): Terminated {rc=256} 04:34:29.672528 --- ParallelTerminationStrategy: PID 9054 died... 04:34:29.691047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Terminated: ok {rc=0} 04:34:29.734644 --- ParallelTerminationStrategy: PID 9057 died... 04:34:29.753172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Terminated: ok {rc=0} 04:34:29.796811 --- ParallelTerminationStrategy: PID 9060 died... 04:34:29.816002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Terminated: ok {rc=0} 04:34:29.899805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 04:34:31.046555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.059002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:31.126089 tst iperf3m4.py: using LAC 38579 04:34:31.273872 tst iperf3m4.py: using RAC 74 04:34:31.408277 tst iperf3m4.py: using CellId 38579 04:34:31.538919 tst iperf3m4.py: using BVCI 38580 04:34:31.661466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.674482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.687088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.699568 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.712819 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.727135 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.741018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.754594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:31.768707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:31.896059 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:32.045162 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:32.199113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:32.325831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:34:32.544044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:32.867733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9062): Launched 04:34:33.150240 run iperf3-srv_10.42.42.10(pid=9063): Launched 04:34:33.273336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:34:33.492154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:33.816900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9064): Launched 04:34:34.099359 run iperf3-srv_10.42.42.10(pid=9065): Launched 04:34:34.221367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:34:34.438872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:34.763911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9066): Launched 04:34:35.045394 run iperf3-srv_10.42.42.10(pid=9067): Launched 04:34:35.159266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:34:35.360607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:34:35.663588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9068): Launched 04:34:35.927237 run iperf3-srv_10.42.42.10(pid=9069): Launched 04:34:36.042110 tst iperf3m4.py:8: start network... 04:34:36.242780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:36.712516 run create_hlr_db(pid=9070): Launched 04:34:36.835240 bus /gobi_6: Setting Powered False 04:34:37.895197 run create_hlr_db(pid=9070): Terminated: ok {rc=0} 04:34:38.315160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Launched 04:34:38.617864 run osmo-hlr_10.42.42.2(pid=9073): Launched 04:34:38.731356 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:39.268227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Launched 04:34:39.571429 run osmo-stp_10.42.42.5(pid=9076): Launched 04:34:39.684341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:40.202285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Launched 04:34:40.318083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:40.573451 run patchelf(pid=9079): Launched 04:34:40.740871 run osmo-stp_10.42.42.5(pid=9076): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] 04:34:40.868285 run osmo-stp_10.42.42.5(pid=9076): stdout: | (launched: 2022-12-14_04:34:39.514781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:40.997277 run osmo-stp_10.42.42.5(pid=9076): stderr: | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043439685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:41.126391 run osmo-stp_10.42.42.5(pid=9076): stdout: | (launched: 2022-12-14_04:34:39.514781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:41.249845 run osmo-stp_10.42.42.5(pid=9076): stderr: | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043439684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043439685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043439685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:41.396101 run patchelf(pid=9079): Terminating (SIGINT) 04:34:41.564786 run patchelf(pid=9079): Terminated: ok {rc=0} 04:34:41.686647 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9076): Process ended prematurely: osmo-stp_10.42.42.5(pid=9076) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 04:34:41.696257 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:34:41.723697 run osmo-hlr_10.42.42.2(pid=9073): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9073)] 04:34:41.771333 run osmo-hlr_10.42.42.2(pid=9073): stdout: | (launched: 2022-12-14_04:34:38.561369) 04:34:41.820581 run osmo-hlr_10.42.42.2(pid=9073): stderr: | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043438735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043438747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043438756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043438757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043438757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:41.870231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9062): Terminating (SIGTERM) 04:34:41.909928 run iperf3-srv_10.42.42.10(pid=9063): Terminating (SIGTERM) 04:34:41.950573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9064): Terminating (SIGTERM) 04:34:41.990767 run iperf3-srv_10.42.42.10(pid=9065): Terminating (SIGTERM) 04:34:42.030628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9066): Terminating (SIGTERM) 04:34:42.070669 run iperf3-srv_10.42.42.10(pid=9067): Terminating (SIGTERM) 04:34:42.110590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9068): Terminating (SIGTERM) 04:34:42.150062 run iperf3-srv_10.42.42.10(pid=9069): Terminating (SIGTERM) 04:34:42.189393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Terminating (SIGTERM) 04:34:42.229356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Terminating (SIGTERM) 04:34:42.269285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Terminating (SIGTERM) 04:34:42.309420 --- ParallelTerminationStrategy: PID 9062 died... 04:34:42.328477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9062): Terminated: ok {rc=0} 04:34:42.372264 --- ParallelTerminationStrategy: PID 9063 died... 04:34:42.390828 run iperf3-srv_10.42.42.10(pid=9063): Terminated {rc=256} 04:34:42.434320 --- ParallelTerminationStrategy: PID 9064 died... 04:34:42.452833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9064): Terminated: ok {rc=0} 04:34:42.496932 --- ParallelTerminationStrategy: PID 9065 died... 04:34:42.515647 run iperf3-srv_10.42.42.10(pid=9065): Terminated {rc=256} 04:34:42.559167 --- ParallelTerminationStrategy: PID 9066 died... 04:34:42.577755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9066): Terminated: ok {rc=0} 04:34:42.621738 --- ParallelTerminationStrategy: PID 9067 died... 04:34:42.640157 run iperf3-srv_10.42.42.10(pid=9067): Terminated {rc=256} 04:34:42.683672 --- ParallelTerminationStrategy: PID 9068 died... 04:34:42.702219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9068): Terminated: ok {rc=0} 04:34:42.745741 --- ParallelTerminationStrategy: PID 9069 died... 04:34:42.764210 run iperf3-srv_10.42.42.10(pid=9069): Terminated {rc=256} 04:34:42.807781 --- ParallelTerminationStrategy: PID 9072 died... 04:34:42.826348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9072): Terminated: ok {rc=0} 04:34:42.869808 --- ParallelTerminationStrategy: PID 9075 died... 04:34:42.888316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9075): Terminated: ok {rc=0} 04:34:42.932126 --- ParallelTerminationStrategy: PID 9078 died... 04:34:42.950817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9078): Terminated: ok {rc=0} 04:34:43.036229 bus /gobi_4: Setting Powered False 04:34:44.137122 bus /gobi_4: Setting Powered False 04:34:45.254031 bus /gobi_1: Setting Powered False 04:34:46.350360 bus /gobi_1: Setting Powered False 04:34:47.470263 bus /gobi_0: Setting Powered False 04:34:48.569818 bus /gobi_0: Setting Powered False 04:34:49.686707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 04:34:50.790516 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:50.802530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:50.869291 tst ping.py: using LAC 38580 04:34:50.985422 tst ping.py: using RAC 75 04:34:51.100211 tst ping.py: using CellId 38580 04:34:51.215035 tst ping.py: using BVCI 38581 04:34:51.321110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.332069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.342900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.353812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.364537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.375359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.386338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:51.397262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:51.515117 tst ping.py:19: start network... 04:34:51.728317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:34:52.218249 run create_hlr_db(pid=9080): Launched 04:34:52.340594 bus /gobi_6: Setting Powered False 04:34:53.403780 run create_hlr_db(pid=9080): Terminated: ok {rc=0} 04:34:53.845905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9082): Launched 04:34:54.164586 run osmo-hlr_10.42.42.2(pid=9083): Launched 04:34:54.287013 run osmo-stp_10.42.42.5: Starting osmo-stp 04:34:54.835298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9085): Launched 04:34:55.151779 run osmo-stp_10.42.42.5(pid=9086): Launched 04:34:55.274331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:34:55.823406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9088): Launched 04:34:55.945704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:34:56.213720 run patchelf(pid=9089): Launched 04:34:56.391110 run osmo-stp_10.42.42.5(pid=9086): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9086)] 04:34:56.525375 run osmo-stp_10.42.42.5(pid=9086): stdout: | (launched: 2022-12-14_04:34:55.093371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:56.662284 run osmo-stp_10.42.42.5(pid=9086): stderr: | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043455286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:56.798745 run osmo-stp_10.42.42.5(pid=9086): stdout: | (launched: 2022-12-14_04:34:55.093371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:34:56.929035 run osmo-stp_10.42.42.5(pid=9086): stderr: | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043455285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043455286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043455286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:34:57.082903 run patchelf(pid=9089): Terminating (SIGINT) 04:34:57.260101 run patchelf(pid=9089): Terminated: ok {rc=0} 04:34:57.388511 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9086): Process ended prematurely: osmo-stp_10.42.42.5(pid=9086) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9086)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 04:34:57.398257 tst ping.py:22: Test FAILED (6.6 sec) 04:34:57.426288 run osmo-hlr_10.42.42.2(pid=9083): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9083)] 04:34:57.476651 run osmo-hlr_10.42.42.2(pid=9083): stdout: | (launched: 2022-12-14_04:34:54.106277) 04:34:57.528930 run osmo-hlr_10.42.42.2(pid=9083): stderr: | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043454302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043454314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043454322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043454322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043454322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:34:57.581595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9082): Terminating (SIGTERM) 04:34:57.623069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9085): Terminating (SIGTERM) 04:34:57.665089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9088): Terminating (SIGTERM) 04:34:57.707259 --- ParallelTerminationStrategy: PID 9082 died... 04:34:57.727576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9082): Terminated: ok {rc=0} 04:34:57.773826 --- ParallelTerminationStrategy: PID 9085 died... 04:34:57.793569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9085): Terminated: ok {rc=0} 04:34:57.839560 --- ParallelTerminationStrategy: PID 9088 died... 04:34:57.859251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9088): Terminated: ok {rc=0} 04:34:57.947439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 04:34:59.033580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.045951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 04:34:59.116876 tst ping_idle_ping.py: using LAC 38581 04:34:59.241640 tst ping_idle_ping.py: using RAC 76 04:34:59.359032 tst ping_idle_ping.py: using CellId 38581 04:34:59.477645 tst ping_idle_ping.py: using BVCI 38582 04:34:59.586293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.597463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.608402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.619340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.630350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.641324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.652343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 04:34:59.663394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 04:34:59.781423 tst ping_idle_ping.py:24: start network... 04:34:59.994790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:00.489067 run create_hlr_db(pid=9090): Launched 04:35:00.611802 bus /gobi_6: Setting Powered False 04:35:01.673401 run create_hlr_db(pid=9090): Terminated: ok {rc=0} 04:35:02.125719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Launched 04:35:02.455525 run osmo-hlr_10.42.42.2(pid=9096): Launched 04:35:02.577100 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:03.132510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Launched 04:35:03.451869 run osmo-stp_10.42.42.5(pid=9099): Launched 04:35:03.574955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:04.129137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9101): Launched 04:35:04.250732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:04.519605 run patchelf(pid=9102): Launched 04:35:04.698160 run osmo-stp_10.42.42.5(pid=9099): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] 04:35:04.833452 run osmo-stp_10.42.42.5(pid=9099): stdout: | (launched: 2022-12-14_04:35:03.392878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:04.970860 run osmo-stp_10.42.42.5(pid=9099): stderr: | [0;m[38;5;43m20221214043503583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043503584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043503584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043503584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:05.107720 run osmo-stp_10.42.42.5(pid=9099): stdout: | (launched: 2022-12-14_04:35:03.392878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:05.238375 run osmo-stp_10.42.42.5(pid=9099): stderr: | [0;m[38;5;43m20221214043503583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043503584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043503584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043503584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043503585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:05.393060 run patchelf(pid=9102): Terminating (SIGINT) 04:35:05.570887 run patchelf(pid=9102): Terminated: ok {rc=0} 04:35:05.699143 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9099): Process ended prematurely: osmo-stp_10.42.42.5(pid=9099) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 04:35:05.708871 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 04:35:05.737378 run osmo-hlr_10.42.42.2(pid=9096): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9096)] 04:35:05.788275 run osmo-hlr_10.42.42.2(pid=9096): stdout: | (launched: 2022-12-14_04:35:02.396325) 04:35:05.840923 run osmo-hlr_10.42.42.2(pid=9096): stderr: | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043502594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043502606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043502614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043502614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043502614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:05.894278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Terminating (SIGTERM) 04:35:05.936191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Terminating (SIGTERM) 04:35:05.978449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9101): Terminating (SIGTERM) 04:35:06.021130 --- ParallelTerminationStrategy: PID 9095 died... 04:35:06.041533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Terminated: ok {rc=0} 04:35:06.088252 --- ParallelTerminationStrategy: PID 9098 died... 04:35:06.108357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Terminated: ok {rc=0} 04:35:06.155107 --- ParallelTerminationStrategy: PID 9101 died... 04:35:06.175036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9101): Terminated: ok {rc=0} 04:35:06.263545 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:35:07.568668 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:07.575825 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:35:07.605536 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:35:07.641888 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:35:07.696030 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:35:07.725595 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:35:07.761082 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:35:08.322655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:35:08.328137 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.339959 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:35:08.410086 tst switch_tch_pdch.py: using LAC 38582 04:35:08.533728 tst switch_tch_pdch.py: using RAC 77 04:35:08.655299 tst switch_tch_pdch.py: using CellId 38582 04:35:08.777379 tst switch_tch_pdch.py: using BVCI 38583 04:35:08.892323 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.904232 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.915898 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.927695 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.939699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.951659 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.963703 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:35:08.975635 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:35:09.092511 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:35:09.212205 tst switch_tch_pdch.py:51: start network... 04:35:09.424305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:09.914221 run create_hlr_db(pid=9107): Launched 04:35:10.034410 bus /gobi_6: Setting Powered False 04:35:11.097515 run create_hlr_db(pid=9107): Terminated: ok {rc=0} 04:35:11.540084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Launched 04:35:11.856786 run osmo-hlr_10.42.42.2(pid=9110): Launched 04:35:11.977955 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:12.523790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Launched 04:35:12.841615 run osmo-stp_10.42.42.5(pid=9113): Launched 04:35:12.963075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:13.511420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9115): Launched 04:35:13.634820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:13.903421 run patchelf(pid=9116): Launched 04:35:14.081410 run osmo-stp_10.42.42.5(pid=9113): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] 04:35:14.215763 run osmo-stp_10.42.42.5(pid=9113): stdout: | (launched: 2022-12-14_04:35:12.782475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:14.352426 run osmo-stp_10.42.42.5(pid=9113): stderr: | [0;m[38;5;43m20221214043512972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043512973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043512973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043512973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:14.489397 run osmo-stp_10.42.42.5(pid=9113): stdout: | (launched: 2022-12-14_04:35:12.782475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:14.619458 run osmo-stp_10.42.42.5(pid=9113): stderr: | [0;m[38;5;43m20221214043512972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043512973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043512973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043512973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:14.773582 run patchelf(pid=9116): Terminating (SIGINT) 04:35:14.950860 run patchelf(pid=9116): Terminated: ok {rc=0} 04:35:15.078240 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9113): Process ended prematurely: osmo-stp_10.42.42.5(pid=9113) [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:35:15.087959 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 04:35:15.116037 run osmo-hlr_10.42.42.2(pid=9110): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9110)] 04:35:15.166829 run osmo-hlr_10.42.42.2(pid=9110): stdout: | (launched: 2022-12-14_04:35:11.797961) 04:35:15.219466 run osmo-hlr_10.42.42.2(pid=9110): stderr: | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043511994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043512010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043512020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043512020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043512021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:15.271713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Terminating (SIGTERM) 04:35:15.313552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Terminating (SIGTERM) 04:35:15.355831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9115): Terminating (SIGTERM) 04:35:15.398007 --- ParallelTerminationStrategy: PID 9109 died... 04:35:15.418277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Terminated: ok {rc=0} 04:35:15.464446 --- ParallelTerminationStrategy: PID 9112 died... 04:35:15.484398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Terminated: ok {rc=0} 04:35:15.530521 --- ParallelTerminationStrategy: PID 9115 died... 04:35:15.550381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9115): Terminated: ok {rc=0} 04:35:15.638657 bus /gobi_0: Setting Powered False 04:35:16.740440 bus /gobi_0: Setting Powered False 04:35:17.869178 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 04:35:19.133045 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:19.139710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 04:35:19.169432 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 04:35:19.205860 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 04:35:19.258949 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 04:35:19.288868 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 04:35:19.324126 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 04:35:19.881443 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 04:35:19.886351 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:19.897768 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 04:35:19.961308 tst switch_tch_pdch.py: using LAC 38583 04:35:20.074655 tst switch_tch_pdch.py: using RAC 78 04:35:20.188368 tst switch_tch_pdch.py: using CellId 38583 04:35:20.302327 tst switch_tch_pdch.py: using BVCI 38584 04:35:20.409132 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.420196 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.431048 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.441983 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.452865 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.463810 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.474769 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 04:35:20.485667 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:35:20.603887 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 04:35:20.718551 tst switch_tch_pdch.py:51: start network... 04:35:20.915085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:21.344597 run create_hlr_db(pid=9120): Launched 04:35:21.464684 bus /gobi_6: Setting Powered False 04:35:22.527720 run create_hlr_db(pid=9120): Terminated: ok {rc=0} 04:35:22.926932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9122): Launched 04:35:23.221208 run osmo-hlr_10.42.42.2(pid=9123): Launched 04:35:23.331693 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:23.818167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9125): Launched 04:35:24.114095 run osmo-stp_10.42.42.5(pid=9126): Launched 04:35:24.224703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:35:24.709343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9128): Launched 04:35:24.822654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:35:25.072145 run patchelf(pid=9129): Launched 04:35:25.236357 run osmo-stp_10.42.42.5(pid=9126): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9126)] 04:35:25.361429 run osmo-stp_10.42.42.5(pid=9126): stdout: | (launched: 2022-12-14_04:35:24.059197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:25.488056 run osmo-stp_10.42.42.5(pid=9126): stderr: | [0;m[38;5;43m20221214043524226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043524227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043524227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043524227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:25.615016 run osmo-stp_10.42.42.5(pid=9126): stdout: | (launched: 2022-12-14_04:35:24.059197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:25.735492 run osmo-stp_10.42.42.5(pid=9126): stderr: | [0;m[38;5;43m20221214043524226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043524227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043524227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043524227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043524228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:25.878271 run patchelf(pid=9129): Terminating (SIGINT) 04:35:26.043349 run patchelf(pid=9129): Terminated: ok {rc=0} 04:35:26.162416 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9126): Process ended prematurely: osmo-stp_10.42.42.5(pid=9126) [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9126)] [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 04:35:26.171382 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 04:35:26.197815 run osmo-hlr_10.42.42.2(pid=9123): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9123)] 04:35:26.245291 run osmo-hlr_10.42.42.2(pid=9123): stdout: | (launched: 2022-12-14_04:35:23.166236) 04:35:26.294312 run osmo-hlr_10.42.42.2(pid=9123): stderr: | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043523340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043523352 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043523361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043523361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043523361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:26.343662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9122): Terminating (SIGTERM) 04:35:26.383089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9125): Terminating (SIGTERM) 04:35:26.422589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9128): Terminating (SIGTERM) 04:35:26.462207 --- ParallelTerminationStrategy: PID 9122 died... 04:35:26.480940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9122): Terminated: ok {rc=0} 04:35:26.524497 --- ParallelTerminationStrategy: PID 9125 died... 04:35:26.542977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9125): Terminated: ok {rc=0} 04:35:26.586346 --- ParallelTerminationStrategy: PID 9128 died... 04:35:26.604790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9128): Terminated: ok {rc=0} 04:35:26.688172 bus /gobi_0: Setting Powered False 04:35:27.787232 bus /gobi_0: Setting Powered False 04:35:28.907014 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_sms:nanobts --------------------------------------------------------------------- 04:35:30.155659 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:30.159751 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 04:35:30.183568 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 04:35:30.190792 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 04:35:30.244237 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 04:35:30.268592 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 04:35:30.275339 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 04:35:30.809875 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 04:35:30.815001 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 04:35:30.826030 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 04:35:30.890296 tst mo_mt_sms.py: using LAC 38584 04:35:31.022145 tst mo_mt_sms.py: using RAC 79 04:35:31.160578 tst mo_mt_sms.py: using CellId 38584 04:35:31.296800 tst mo_mt_sms.py: using BVCI 38585 04:35:31.454102 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:35:31.605853 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 04:35:31.753999 tst mo_mt_sms.py:9: start nitb and bts... 04:35:31.977371 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:35:32.592172 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9134): Launched 04:35:32.888148 run osmo-nitb_10.42.42.2(pid=9135): Launched 04:35:33.052068 run osmo-nitb_10.42.42.2(pid=9135): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9135)] 04:35:33.185715 run osmo-nitb_10.42.42.2(pid=9135): stdout: | (launched: 2022-12-14_04:35:32.832460) 04:35:33.320649 run osmo-nitb_10.42.42.2(pid=9135): stderr: | (launched: 2022-12-14_04:35:32.876804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:33.455464 run osmo-nitb_10.42.42.2(pid=9135): stdout: | (launched: 2022-12-14_04:35:32.832460) 04:35:33.583838 run osmo-nitb_10.42.42.2(pid=9135): stderr: | (launched: 2022-12-14_04:35:32.876804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9135): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9135) [trial-2399↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9135)] 04:35:33.999367 tst osmo-nitb_10.42.42.2(pid=9135): stdout: | (launched: 2022-12-14_04:35:32.832460) 04:35:34.118754 tst osmo-nitb_10.42.42.2(pid=9135): stderr: | (launched: 2022-12-14_04:35:32.876804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:34.259622 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9135): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9135) [trial-2399↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9135)] [trial-2399↪nitb_sms:nanobts↪mo_mt_sms.py:11] 04:35:34.268081 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 04:35:34.274680 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9134): Terminating (SIGTERM) 04:35:34.483314 --- ParallelTerminationStrategy: PID 9134 died... 04:35:34.503962 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9134): Terminated: ok {rc=0} 04:35:34.590080 bus /sierra_3: Setting Powered False 04:35:35.690938 bus /sierra_3: Setting Powered False 04:35:36.812299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:nanobts+band-1900 --------------------------------------------------------------------- 04:35:37.997529 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:38.002371 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:38.025663 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:35:38.052015 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 04:35:38.103120 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:38.126459 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:35:38.152491 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 04:35:38.699977 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 04:35:38.706218 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:38.717365 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:38.755528 tst mo_mt_sms.py: using LAC 38585 04:35:38.886221 tst mo_mt_sms.py: using RAC 80 04:35:39.003266 tst mo_mt_sms.py: using CellId 38585 04:35:39.120391 tst mo_mt_sms.py: using BVCI 38586 04:35:39.226829 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:39.237776 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:39.248504 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:39.258935 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:39.269466 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:39.279894 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:35:39.398563 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 04:35:39.516448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:40.007981 run create_hlr_db(pid=9139): Launched 04:35:40.129814 bus /sierra_2: Setting Powered False 04:35:41.188734 run create_hlr_db(pid=9139): Terminated: ok {rc=0} 04:35:41.632611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Launched 04:35:41.970898 run osmo-hlr_10.42.42.2(pid=9142): Launched 04:35:42.085899 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:42.631510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Launched 04:35:42.950307 run osmo-stp_10.42.42.5(pid=9145): Launched 04:35:43.070923 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:43.643945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9147): Launched 04:35:43.962843 run osmo-msc_10.42.42.6(pid=9148): Launched 04:35:44.138445 run osmo-stp_10.42.42.5(pid=9145): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] 04:35:44.272431 run osmo-stp_10.42.42.5(pid=9145): stdout: | (launched: 2022-12-14_04:35:42.891542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:44.407361 run osmo-stp_10.42.42.5(pid=9145): stderr: | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043543083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:44.541277 run osmo-stp_10.42.42.5(pid=9145): stdout: | (launched: 2022-12-14_04:35:42.891542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:35:44.667429 run osmo-stp_10.42.42.5(pid=9145): stderr: | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043543082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043543083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043543083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:35:44.818228 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9145): Process ended prematurely: osmo-stp_10.42.42.5(pid=9145) [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 04:35:44.827144 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 04:35:44.854340 run osmo-hlr_10.42.42.2(pid=9142): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9142)] 04:35:44.905195 run osmo-hlr_10.42.42.2(pid=9142): stdout: | (launched: 2022-12-14_04:35:41.906902) 04:35:44.957250 run osmo-hlr_10.42.42.2(pid=9142): stderr: | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043542086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043542098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043542106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043542106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043542106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:35:45.029611 run osmo-msc_10.42.42.6(pid=9148): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9148)] 04:35:45.079577 run osmo-msc_10.42.42.6(pid=9148): stdout: | (launched: 2022-12-14_04:35:43.903803) 04:35:45.131662 run osmo-msc_10.42.42.6(pid=9148): stderr: | [0;m[38;5;43m20221214043544223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043544223 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efcdda6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043544224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043544224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043544224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043544224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043544226 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043544226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043544226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043544226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:35:45.183860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Terminating (SIGTERM) 04:35:45.225636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Terminating (SIGTERM) 04:35:45.267823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9147): Terminating (SIGTERM) 04:35:45.309819 --- ParallelTerminationStrategy: PID 9141 died... 04:35:45.330055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Terminated: ok {rc=0} 04:35:45.376206 --- ParallelTerminationStrategy: PID 9144 died... 04:35:45.395971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Terminated: ok {rc=0} 04:35:45.442139 --- ParallelTerminationStrategy: PID 9147 died... 04:35:45.461967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9147): Terminated: ok {rc=0} 04:35:45.549337 bus /sierra_3: Setting Powered False 04:35:46.654633 bus /sierra_3: Setting Powered False 04:35:47.786799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:35:49.013602 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:49.018674 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:49.042473 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 04:35:49.049324 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:35:49.083656 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:49.107138 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 04:35:49.113847 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:35:49.634646 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:35:49.639813 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 04:35:49.650764 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:49.688133 tst assert_extension.py: using LAC 38586 04:35:49.802957 tst assert_extension.py: using RAC 81 04:35:49.920344 tst assert_extension.py: using CellId 38586 04:35:50.036108 tst assert_extension.py: using BVCI 38587 04:35:50.144106 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:35:50.262570 tst assert_extension.py:10: start nitb and bts... 04:35:50.474842 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:35:51.121039 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9153): Launched 04:35:51.436597 run osmo-nitb_10.42.42.2(pid=9154): Launched 04:35:51.613168 run osmo-nitb_10.42.42.2(pid=9154): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9154)] 04:35:51.755667 run osmo-nitb_10.42.42.2(pid=9154): stdout: | (launched: 2022-12-14_04:35:51.378454) 04:35:51.899914 run osmo-nitb_10.42.42.2(pid=9154): stderr: | (launched: 2022-12-14_04:35:51.425451) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:52.045344 run osmo-nitb_10.42.42.2(pid=9154): stdout: | (launched: 2022-12-14_04:35:51.378454) 04:35:52.182986 run osmo-nitb_10.42.42.2(pid=9154): stderr: | (launched: 2022-12-14_04:35:51.425451) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9154): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9154) [trial-2399↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9154)] 04:35:52.557488 tst osmo-nitb_10.42.42.2(pid=9154): stdout: | (launched: 2022-12-14_04:35:51.378454) 04:35:52.685305 tst osmo-nitb_10.42.42.2(pid=9154): stderr: | (launched: 2022-12-14_04:35:51.425451) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:35:52.835716 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9154): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9154) [trial-2399↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9154)] [trial-2399↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 04:35:52.844751 tst assert_extension.py:12: Test FAILED (3.2 sec) 04:35:52.851792 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9153): Terminating (SIGTERM) 04:35:53.062551 --- ParallelTerminationStrategy: PID 9153 died... 04:35:53.084186 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9153): Terminated: ok {rc=0} 04:35:53.173847 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:nanobts+band-1900 --------------------------------------------------------------------- 04:35:54.339190 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:35:54.344552 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:35:54.368588 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:35:54.395802 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 04:35:54.435216 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:35:54.459652 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:35:54.485786 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 04:35:55.009768 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 04:35:55.014938 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.025849 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:35:55.062296 tst assert_extension.py: using LAC 38587 04:35:55.177468 tst assert_extension.py: using RAC 82 04:35:55.291581 tst assert_extension.py: using CellId 38587 04:35:55.407280 tst assert_extension.py: using BVCI 38588 04:35:55.513647 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.524252 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.534727 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.545176 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.555774 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:35:55.566439 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 04:35:55.683767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:35:56.174706 run create_hlr_db(pid=9162): Launched 04:35:56.295673 bus /sierra_2: Setting Powered False 04:35:57.359339 run create_hlr_db(pid=9162): Terminated: ok {rc=0} 04:35:57.782780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9164): Launched 04:35:58.078638 run osmo-hlr_10.42.42.2(pid=9165): Launched 04:35:58.190806 run osmo-stp_10.42.42.5: Starting osmo-stp 04:35:58.716709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9167): Launched 04:35:59.011415 run osmo-stp_10.42.42.5(pid=9168): Launched 04:35:59.124600 run osmo-msc_10.42.42.6: Starting osmo-msc 04:35:59.657615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9170): Launched 04:35:59.954827 run osmo-msc_10.42.42.6(pid=9171): Launched 04:36:00.118876 run osmo-stp_10.42.42.5(pid=9168): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9168)] 04:36:00.243813 run osmo-stp_10.42.42.5(pid=9168): stdout: | (launched: 2022-12-14_04:35:58.956750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:00.368683 run osmo-stp_10.42.42.5(pid=9168): stderr: | [0;m[38;5;43m20221214043559125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043559126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043559126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043559126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:00.492450 run osmo-stp_10.42.42.5(pid=9168): stdout: | (launched: 2022-12-14_04:35:58.956750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:00.609805 run osmo-stp_10.42.42.5(pid=9168): stderr: | [0;m[38;5;43m20221214043559125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043559126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043559126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043559126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043559127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:00.749915 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9168): Process ended prematurely: osmo-stp_10.42.42.5(pid=9168) [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9168)] [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py:17] 04:36:00.758235 tst assert_extension.py:17: Test FAILED (5.7 sec) 04:36:00.784017 run osmo-hlr_10.42.42.2(pid=9165): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9165)] 04:36:00.839288 run osmo-hlr_10.42.42.2(pid=9165): stdout: | (launched: 2022-12-14_04:35:58.023703) 04:36:00.914034 run osmo-hlr_10.42.42.2(pid=9165): stderr: | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043558200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043558212 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043558222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043558222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043558222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:00.985771 run osmo-msc_10.42.42.6(pid=9171): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9171)] 04:36:01.037706 run osmo-msc_10.42.42.6(pid=9171): stdout: | (launched: 2022-12-14_04:35:59.898972) 04:36:01.088628 run osmo-msc_10.42.42.6(pid=9171): stderr: | [0;m[38;5;43m20221214043600167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043600167 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcee2bd7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043600167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043600167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043600168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043600168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043600169 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043600170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043600170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043600170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:01.141694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9164): Terminating (SIGTERM) 04:36:01.183436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9167): Terminating (SIGTERM) 04:36:01.226424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9170): Terminating (SIGTERM) 04:36:01.268690 --- ParallelTerminationStrategy: PID 9164 died... 04:36:01.288877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9164): Terminated: ok {rc=0} 04:36:01.334869 --- ParallelTerminationStrategy: PID 9167 died... 04:36:01.354964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9167): Terminated: ok {rc=0} 04:36:01.400612 --- ParallelTerminationStrategy: PID 9170 died... 04:36:01.420734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9170): Terminated: ok {rc=0} 04:36:01.518680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:36:02.738815 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:02.746974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:36:02.771347 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:36:02.799464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:36:02.852480 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:36:02.876348 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:36:02.903411 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:36:03.458860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:36:03.512437 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:03.524299 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:36:03.588450 tst mo_mt_call.py: using LAC 38588 04:36:03.714279 tst mo_mt_call.py: using RAC 83 04:36:03.838693 tst mo_mt_call.py: using CellId 38588 04:36:03.965318 tst mo_mt_call.py: using BVCI 38589 04:36:04.082157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:04.093866 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:04.105313 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:04.116762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:04.128824 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:04.140658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:04.256387 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:04.375788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:04.874396 run create_hlr_db(pid=9176): Launched 04:36:04.997958 bus /sierra_2: Setting Powered False 04:36:06.060877 run create_hlr_db(pid=9176): Terminated: ok {rc=0} 04:36:06.490919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Launched 04:36:06.792283 run osmo-hlr_10.42.42.2(pid=9179): Launched 04:36:06.907916 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:07.427264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Launched 04:36:07.727303 run osmo-stp_10.42.42.5(pid=9182): Launched 04:36:07.840934 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:08.385288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9184): Launched 04:36:08.686559 run osmo-msc_10.42.42.6(pid=9185): Launched 04:36:08.855007 run osmo-stp_10.42.42.5(pid=9182): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] 04:36:08.982299 run osmo-stp_10.42.42.5(pid=9182): stdout: | (launched: 2022-12-14_04:36:07.671518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:09.109552 run osmo-stp_10.42.42.5(pid=9182): stderr: | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043607844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:09.235391 run osmo-stp_10.42.42.5(pid=9182): stdout: | (launched: 2022-12-14_04:36:07.671518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:09.354691 run osmo-stp_10.42.42.5(pid=9182): stderr: | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043607843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043607844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043607844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:09.497298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9182): Process ended prematurely: osmo-stp_10.42.42.5(pid=9182) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:36:09.506310 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 04:36:09.532377 run osmo-hlr_10.42.42.2(pid=9179): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9179)] 04:36:09.579844 run osmo-hlr_10.42.42.2(pid=9179): stdout: | (launched: 2022-12-14_04:36:06.735785) 04:36:09.628684 run osmo-hlr_10.42.42.2(pid=9179): stderr: | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043606909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043606929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043606939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043606940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043606940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:09.697214 run osmo-msc_10.42.42.6(pid=9185): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9185)] 04:36:09.744206 run osmo-msc_10.42.42.6(pid=9185): stdout: | (launched: 2022-12-14_04:36:08.629825) 04:36:09.792900 run osmo-msc_10.42.42.6(pid=9185): stderr: | [0;m[38;5;43m20221214043608900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043608900 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f2e767c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043608900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043608901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043608901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043608901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043608903 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043608903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043608903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043608903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:09.841986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Terminating (SIGTERM) 04:36:09.880804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Terminating (SIGTERM) 04:36:09.919695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9184): Terminating (SIGTERM) 04:36:09.959120 --- ParallelTerminationStrategy: PID 9178 died... 04:36:09.978293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Terminated: ok {rc=0} 04:36:10.022034 --- ParallelTerminationStrategy: PID 9181 died... 04:36:10.040545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Terminated: ok {rc=0} 04:36:10.083890 --- ParallelTerminationStrategy: PID 9184 died... 04:36:10.102513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9184): Terminated: ok {rc=0} 04:36:10.187365 bus /sierra_3: Setting Powered False 04:36:11.289853 bus /sierra_3: Setting Powered False 04:36:12.406758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:36:13.556248 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:13.568801 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:36:13.635826 tst mo_mt_call_osmux.py: using LAC 38589 04:36:13.762323 tst mo_mt_call_osmux.py: using RAC 84 04:36:13.888819 tst mo_mt_call_osmux.py: using CellId 38589 04:36:14.018569 tst mo_mt_call_osmux.py: using BVCI 38590 04:36:14.137519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:14.149288 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:14.160709 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:14.172283 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:14.184220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:36:14.196091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:14.314133 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:36:14.434638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:14.935450 run create_hlr_db(pid=9187): Launched 04:36:15.059941 bus /sierra_2: Setting Powered False 04:36:16.150214 run create_hlr_db(pid=9187): Terminated: ok {rc=0} 04:36:16.586397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9189): Launched 04:36:16.924153 run osmo-hlr_10.42.42.2(pid=9190): Launched 04:36:17.171276 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:17.725616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9192): Launched 04:36:18.030189 run osmo-stp_10.42.42.5(pid=9193): Launched 04:36:18.144505 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:18.689378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9195): Launched 04:36:18.991278 run osmo-msc_10.42.42.6(pid=9196): Launched 04:36:19.160214 run osmo-stp_10.42.42.5(pid=9193): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9193)] 04:36:19.288310 run osmo-stp_10.42.42.5(pid=9193): stdout: | (launched: 2022-12-14_04:36:17.973256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:19.415640 run osmo-stp_10.42.42.5(pid=9193): stderr: | [0;m[38;5;43m20221214043618144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043618144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043618145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043618145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043618145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043618146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043618146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:19.540646 run osmo-stp_10.42.42.5(pid=9193): stdout: | (launched: 2022-12-14_04:36:17.973256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:19.659729 run osmo-stp_10.42.42.5(pid=9193): stderr: | [0;m[38;5;43m20221214043618144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043618144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043618145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043618145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043618145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043618146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043618146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:19.802570 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9193): Process ended prematurely: osmo-stp_10.42.42.5(pid=9193) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9193)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:36:19.811293 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:36:19.837433 run osmo-hlr_10.42.42.2(pid=9190): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9190)] 04:36:19.884575 run osmo-hlr_10.42.42.2(pid=9190): stdout: | (launched: 2022-12-14_04:36:16.851188) 04:36:19.933568 run osmo-hlr_10.42.42.2(pid=9190): stderr: | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043617124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043617156 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043617171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043617172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043617172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:20.001974 run osmo-msc_10.42.42.6(pid=9196): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9196)] 04:36:20.048882 run osmo-msc_10.42.42.6(pid=9196): stdout: | (launched: 2022-12-14_04:36:18.934891) 04:36:20.097407 run osmo-msc_10.42.42.6(pid=9196): stderr: | [0;m[38;5;43m20221214043619208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043619208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ee7067c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043619208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043619208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043619209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043619209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043619211 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043619211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043619211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043619211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:20.146345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9189): Terminating (SIGTERM) 04:36:20.185392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9192): Terminating (SIGTERM) 04:36:20.224429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9195): Terminating (SIGTERM) 04:36:20.263639 --- ParallelTerminationStrategy: PID 9189 died... 04:36:20.282558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9189): Terminated: ok {rc=0} 04:36:20.325694 --- ParallelTerminationStrategy: PID 9192 died... 04:36:20.344079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9192): Terminated: ok {rc=0} 04:36:20.386997 --- ParallelTerminationStrategy: PID 9195 died... 04:36:20.405557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9195): Terminated: ok {rc=0} 04:36:20.489676 bus /sierra_3: Setting Powered False 04:36:21.588734 bus /sierra_3: Setting Powered False 04:36:22.703706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:36:23.946954 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:23.954277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:36:23.977702 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:36:24.004261 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:36:24.056112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:36:24.080614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:36:24.107954 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:36:24.657800 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:36:24.705704 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:24.716849 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:36:24.779703 tst mo_mt_call.py: using LAC 38590 04:36:24.905394 tst mo_mt_call.py: using RAC 85 04:36:25.030243 tst mo_mt_call.py: using CellId 38590 04:36:25.156077 tst mo_mt_call.py: using BVCI 38591 04:36:25.273555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:25.285381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:25.297047 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:25.308766 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:25.320790 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:25.332655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:25.447323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:25.566445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:26.065604 run create_hlr_db(pid=9201): Launched 04:36:26.189595 bus /sierra_2: Setting Powered False 04:36:27.253583 run create_hlr_db(pid=9201): Terminated: ok {rc=0} 04:36:27.701540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9203): Launched 04:36:28.025022 run osmo-hlr_10.42.42.2(pid=9204): Launched 04:36:28.149475 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:28.706783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9206): Launched 04:36:29.031170 run osmo-stp_10.42.42.5(pid=9207): Launched 04:36:29.155537 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:29.739068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9209): Launched 04:36:30.063213 run osmo-msc_10.42.42.6(pid=9210): Launched 04:36:30.243010 run osmo-stp_10.42.42.5(pid=9207): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9207)] 04:36:30.379355 run osmo-stp_10.42.42.5(pid=9207): stdout: | (launched: 2022-12-14_04:36:28.971711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:30.516016 run osmo-stp_10.42.42.5(pid=9207): stderr: | [0;m[38;5;43m20221214043629162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043629163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043629163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043629163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:30.651460 run osmo-stp_10.42.42.5(pid=9207): stdout: | (launched: 2022-12-14_04:36:28.971711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:30.779333 run osmo-stp_10.42.42.5(pid=9207): stderr: | [0;m[38;5;43m20221214043629162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043629163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043629163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043629163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043629164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:30.948693 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9207): Process ended prematurely: osmo-stp_10.42.42.5(pid=9207) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9207)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:36:30.959337 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:36:30.988245 run osmo-hlr_10.42.42.2(pid=9204): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9204)] 04:36:31.042620 run osmo-hlr_10.42.42.2(pid=9204): stdout: | (launched: 2022-12-14_04:36:27.965508) 04:36:31.096678 run osmo-hlr_10.42.42.2(pid=9204): stderr: | [0;m[1;31m20221214043628161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043628161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043628161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043628162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043628162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043628162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043628174 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043628182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043628182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043628182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:31.171890 run osmo-msc_10.42.42.6(pid=9210): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9210)] 04:36:31.223871 run osmo-msc_10.42.42.6(pid=9210): stdout: | (launched: 2022-12-14_04:36:30.003219) 04:36:31.277980 run osmo-msc_10.42.42.6(pid=9210): stderr: | [0;m[38;5;43m20221214043630323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043630323 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29a04a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043630323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043630323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043630323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043630324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043630325 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043630326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043630326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043630326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:31.332416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9203): Terminating (SIGTERM) 04:36:31.375861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9206): Terminating (SIGTERM) 04:36:31.421852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9209): Terminating (SIGTERM) 04:36:31.467476 --- ParallelTerminationStrategy: PID 9203 died... 04:36:31.489294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9203): Terminated: ok {rc=0} 04:36:31.537506 --- ParallelTerminationStrategy: PID 9206 died... 04:36:31.559027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9206): Terminated: ok {rc=0} 04:36:31.607040 --- ParallelTerminationStrategy: PID 9209 died... 04:36:31.628192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9209): Terminated: ok {rc=0} 04:36:31.718901 bus /sierra_3: Setting Powered False 04:36:32.817693 bus /sierra_3: Setting Powered False 04:36:33.932104 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:36:35.077169 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.089129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:36:35.148637 tst mo_mt_call_osmux.py: using LAC 38591 04:36:35.268012 tst mo_mt_call_osmux.py: using RAC 86 04:36:35.386848 tst mo_mt_call_osmux.py: using CellId 38591 04:36:35.506371 tst mo_mt_call_osmux.py: using BVCI 38592 04:36:35.615859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.627091 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.638542 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.649537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.660550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:36:35.671631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:35.785596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:36:35.906286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:36.407439 run create_hlr_db(pid=9212): Launched 04:36:36.531417 bus /sierra_2: Setting Powered False 04:36:37.595899 run create_hlr_db(pid=9212): Terminated: ok {rc=0} 04:36:38.025376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Launched 04:36:38.326445 run osmo-hlr_10.42.42.2(pid=9215): Launched 04:36:38.442489 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:38.979166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Launched 04:36:39.279765 run osmo-stp_10.42.42.5(pid=9218): Launched 04:36:39.394482 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:39.940696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9220): Launched 04:36:40.243328 run osmo-msc_10.42.42.6(pid=9221): Launched 04:36:40.412253 run osmo-stp_10.42.42.5(pid=9218): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] 04:36:40.539299 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-14_04:36:39.223276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:40.666758 run osmo-stp_10.42.42.5(pid=9218): stderr: | [0;m[38;5;43m20221214043639391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043639391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043639392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043639393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:40.792260 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-14_04:36:39.223276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:40.911504 run osmo-stp_10.42.42.5(pid=9218): stderr: | [0;m[38;5;43m20221214043639391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043639391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043639392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043639393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043639393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:41.054482 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:36:41.063337 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:36:41.089666 run osmo-hlr_10.42.42.2(pid=9215): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9215)] 04:36:41.137181 run osmo-hlr_10.42.42.2(pid=9215): stdout: | (launched: 2022-12-14_04:36:38.270561) 04:36:41.186242 run osmo-hlr_10.42.42.2(pid=9215): stderr: | [0;m[1;31m20221214043638444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043638444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043638445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043638445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043638445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043638445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043638457 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043638465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043638465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043638465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:41.254764 run osmo-msc_10.42.42.6(pid=9221): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9221)] 04:36:41.301971 run osmo-msc_10.42.42.6(pid=9221): stdout: | (launched: 2022-12-14_04:36:40.186572) 04:36:41.350791 run osmo-msc_10.42.42.6(pid=9221): stderr: | [0;m[38;5;43m20221214043640457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043640457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3bd9126c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043640457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043640457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043640457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043640458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043640459 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043640460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043640460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043640460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:41.400561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Terminating (SIGTERM) 04:36:41.440429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminating (SIGTERM) 04:36:41.479813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9220): Terminating (SIGTERM) 04:36:41.519111 --- ParallelTerminationStrategy: PID 9214 died... 04:36:41.538373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Terminated: ok {rc=0} 04:36:41.581989 --- ParallelTerminationStrategy: PID 9217 died... 04:36:41.600548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminated: ok {rc=0} 04:36:41.643932 --- ParallelTerminationStrategy: PID 9220 died... 04:36:41.662675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9220): Terminated: ok {rc=0} 04:36:41.749085 bus /sierra_3: Setting Powered False 04:36:42.849349 bus /sierra_3: Setting Powered False 04:36:43.968602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:36:45.211031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:36:45.219094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:36:45.243574 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:36:45.273188 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:36:45.326930 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:36:45.351639 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:36:45.380085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:36:45.963383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:36:46.016840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.029324 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:36:46.090463 tst mo_mt_call.py: using LAC 38592 04:36:46.217870 tst mo_mt_call.py: using RAC 87 04:36:46.370132 tst mo_mt_call.py: using CellId 38592 04:36:46.500371 tst mo_mt_call.py: using BVCI 38593 04:36:46.622184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.634543 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.646770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.659478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.673411 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:46.687938 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:46.815530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:46.949330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:47.425144 run create_hlr_db(pid=9226): Launched 04:36:47.548818 bus /sierra_2: Setting Powered False 04:36:48.609757 run create_hlr_db(pid=9226): Terminated: ok {rc=0} 04:36:49.049545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Launched 04:36:49.374438 run osmo-hlr_10.42.42.2(pid=9229): Launched 04:36:49.497500 run osmo-stp_10.42.42.5: Starting osmo-stp 04:36:50.054217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Launched 04:36:50.376584 run osmo-stp_10.42.42.5(pid=9232): Launched 04:36:50.499731 run osmo-msc_10.42.42.6: Starting osmo-msc 04:36:51.086719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9234): Launched 04:36:51.411868 run osmo-msc_10.42.42.6(pid=9235): Launched 04:36:51.594669 run osmo-stp_10.42.42.5(pid=9232): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] 04:36:51.735406 run osmo-stp_10.42.42.5(pid=9232): stdout: | (launched: 2022-12-14_04:36:50.316524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:51.873076 run osmo-stp_10.42.42.5(pid=9232): stderr: | [0;m[38;5;43m20221214043650507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043650508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043650508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043650508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:52.010398 run osmo-stp_10.42.42.5(pid=9232): stdout: | (launched: 2022-12-14_04:36:50.316524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:36:52.140195 run osmo-stp_10.42.42.5(pid=9232): stderr: | [0;m[38;5;43m20221214043650507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043650508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043650508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043650508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043650509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:36:52.294545 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9232): Process ended prematurely: osmo-stp_10.42.42.5(pid=9232) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:36:52.304258 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:36:52.332497 run osmo-hlr_10.42.42.2(pid=9229): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9229)] 04:36:52.383360 run osmo-hlr_10.42.42.2(pid=9229): stdout: | (launched: 2022-12-14_04:36:49.314910) 04:36:52.436040 run osmo-hlr_10.42.42.2(pid=9229): stderr: | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043649511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043649523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043649531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043649532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043649532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:36:52.508690 run osmo-msc_10.42.42.6(pid=9235): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9235)] 04:36:52.558823 run osmo-msc_10.42.42.6(pid=9235): stdout: | (launched: 2022-12-14_04:36:51.352071) 04:36:52.611271 run osmo-msc_10.42.42.6(pid=9235): stderr: | [0;m[38;5;43m20221214043651674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043651675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31c390dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043651675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043651675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043651675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043651675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043651677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043651677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043651677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043651678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:36:52.664071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Terminating (SIGTERM) 04:36:52.705819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Terminating (SIGTERM) 04:36:52.747963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9234): Terminating (SIGTERM) 04:36:52.790328 --- ParallelTerminationStrategy: PID 9228 died... 04:36:52.810633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Terminated: ok {rc=0} 04:36:52.857248 --- ParallelTerminationStrategy: PID 9231 died... 04:36:52.877283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Terminated: ok {rc=0} 04:36:52.923975 --- ParallelTerminationStrategy: PID 9234 died... 04:36:52.943900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9234): Terminated: ok {rc=0} 04:36:53.032248 bus /sierra_3: Setting Powered False 04:36:54.128561 bus /sierra_3: Setting Powered False 04:36:55.244500 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:36:56.389385 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:56.401531 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:36:56.461613 tst mo_mt_call_osmux.py: using LAC 38593 04:36:56.579731 tst mo_mt_call_osmux.py: using RAC 88 04:36:56.699623 tst mo_mt_call_osmux.py: using CellId 38593 04:36:56.833855 tst mo_mt_call_osmux.py: using BVCI 38594 04:36:56.944214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:56.955628 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:56.966916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:56.978116 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:56.989721 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:36:57.000921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:57.118048 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:36:57.234240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:36:57.700800 run create_hlr_db(pid=9237): Launched 04:36:57.823917 bus /sierra_2: Setting Powered False 04:36:58.884619 run create_hlr_db(pid=9237): Terminated: ok {rc=0} 04:36:59.325377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9239): Launched 04:36:59.650162 run osmo-hlr_10.42.42.2(pid=9240): Launched 04:36:59.775035 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:00.332845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9242): Launched 04:37:00.656836 run osmo-stp_10.42.42.5(pid=9243): Launched 04:37:00.779219 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:01.517388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9245): Launched 04:37:01.844684 run osmo-msc_10.42.42.6(pid=9246): Launched 04:37:02.247412 run osmo-stp_10.42.42.5(pid=9243): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9243)] 04:37:02.464832 run osmo-stp_10.42.42.5(pid=9243): stdout: | (launched: 2022-12-14_04:37:00.596514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:02.600618 run osmo-stp_10.42.42.5(pid=9243): stderr: | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043700789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:02.736116 run osmo-stp_10.42.42.5(pid=9243): stdout: | (launched: 2022-12-14_04:37:00.596514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:02.865276 run osmo-stp_10.42.42.5(pid=9243): stderr: | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043700788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043700789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043700789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:03.020263 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9243): Process ended prematurely: osmo-stp_10.42.42.5(pid=9243) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9243)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:37:03.030129 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 04:37:03.058231 run osmo-hlr_10.42.42.2(pid=9240): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9240)] 04:37:03.109656 run osmo-hlr_10.42.42.2(pid=9240): stdout: | (launched: 2022-12-14_04:36:59.590474) 04:37:03.162259 run osmo-hlr_10.42.42.2(pid=9240): stderr: | [0;m[1;31m20221214043659788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043659788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043659788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043659788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043659789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043659789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043659801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043659809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043659809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043659809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:03.235587 run osmo-msc_10.42.42.6(pid=9246): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9246)] 04:37:03.285762 run osmo-msc_10.42.42.6(pid=9246): stdout: | (launched: 2022-12-14_04:37:01.785810) 04:37:03.338493 run osmo-msc_10.42.42.6(pid=9246): stderr: | [0;m[38;5;43m20221214043702252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043702252 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4aeaabfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043702252 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043702252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043702253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043702253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043702254 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043702255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043702255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043702255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:03.391274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9239): Terminating (SIGTERM) 04:37:03.433149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9242): Terminating (SIGTERM) 04:37:03.475378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9245): Terminating (SIGTERM) 04:37:03.518073 --- ParallelTerminationStrategy: PID 9239 died... 04:37:03.538628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9239): Terminated: ok {rc=0} 04:37:03.585734 --- ParallelTerminationStrategy: PID 9242 died... 04:37:03.605849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9242): Terminated: ok {rc=0} 04:37:03.652460 --- ParallelTerminationStrategy: PID 9245 died... 04:37:03.672505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9245): Terminated: ok {rc=0} 04:37:03.761151 bus /sierra_3: Setting Powered False 04:37:04.860469 bus /sierra_3: Setting Powered False 04:37:05.975387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:37:07.213859 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:07.221089 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:37:07.244477 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:37:07.271032 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:37:07.323443 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:37:07.348379 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:37:07.376289 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:37:07.924390 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:37:07.972126 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:07.983341 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:37:08.041876 tst mo_mt_call.py: using LAC 38594 04:37:08.159049 tst mo_mt_call.py: using RAC 89 04:37:08.276889 tst mo_mt_call.py: using CellId 38594 04:37:08.394647 tst mo_mt_call.py: using BVCI 38595 04:37:08.502847 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:08.514081 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:08.525220 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:08.536186 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:08.547265 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:08.558426 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:08.677506 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:08.794386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:09.262316 run create_hlr_db(pid=9251): Launched 04:37:09.386974 bus /sierra_2: Setting Powered False 04:37:10.446741 run create_hlr_db(pid=9251): Terminated: ok {rc=0} 04:37:10.885667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9253): Launched 04:37:11.208560 run osmo-hlr_10.42.42.2(pid=9254): Launched 04:37:11.331395 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:11.890979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9256): Launched 04:37:12.215905 run osmo-stp_10.42.42.5(pid=9257): Launched 04:37:12.340121 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:12.925501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9259): Launched 04:37:13.250518 run osmo-msc_10.42.42.6(pid=9260): Launched 04:37:13.429771 run osmo-stp_10.42.42.5(pid=9257): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9257)] 04:37:13.566426 run osmo-stp_10.42.42.5(pid=9257): stdout: | (launched: 2022-12-14_04:37:12.156174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:13.703589 run osmo-stp_10.42.42.5(pid=9257): stderr: | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043712346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:13.839717 run osmo-stp_10.42.42.5(pid=9257): stdout: | (launched: 2022-12-14_04:37:12.156174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:13.968629 run osmo-stp_10.42.42.5(pid=9257): stderr: | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043712346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043712346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043712347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:14.123061 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9257): Process ended prematurely: osmo-stp_10.42.42.5(pid=9257) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9257)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:37:14.132377 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 04:37:14.160451 run osmo-hlr_10.42.42.2(pid=9254): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9254)] 04:37:14.211958 run osmo-hlr_10.42.42.2(pid=9254): stdout: | (launched: 2022-12-14_04:37:11.149527) 04:37:14.264065 run osmo-hlr_10.42.42.2(pid=9254): stderr: | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043711344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043711356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043711364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043711365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043711365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:14.337074 run osmo-msc_10.42.42.6(pid=9260): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9260)] 04:37:14.387155 run osmo-msc_10.42.42.6(pid=9260): stdout: | (launched: 2022-12-14_04:37:13.190292) 04:37:14.439310 run osmo-msc_10.42.42.6(pid=9260): stderr: | [0;m[38;5;43m20221214043713510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043713510 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5888862c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043713511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043713511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043713511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043713511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043713513 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043713513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043713513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043713513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:14.491855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9253): Terminating (SIGTERM) 04:37:14.533680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9256): Terminating (SIGTERM) 04:37:14.576194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9259): Terminating (SIGTERM) 04:37:14.618315 --- ParallelTerminationStrategy: PID 9253 died... 04:37:14.638752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9253): Terminated: ok {rc=0} 04:37:14.685209 --- ParallelTerminationStrategy: PID 9256 died... 04:37:14.705003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9256): Terminated: ok {rc=0} 04:37:14.751097 --- ParallelTerminationStrategy: PID 9259 died... 04:37:14.771064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9259): Terminated: ok {rc=0} 04:37:14.858669 bus /sierra_3: Setting Powered False 04:37:15.970305 bus /sierra_3: Setting Powered False 04:37:17.113686 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:37:18.276745 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.289517 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:37:18.352432 tst mo_mt_call_osmux.py: using LAC 38595 04:37:18.482174 tst mo_mt_call_osmux.py: using RAC 90 04:37:18.618250 tst mo_mt_call_osmux.py: using CellId 38595 04:37:18.756132 tst mo_mt_call_osmux.py: using BVCI 38596 04:37:18.875311 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.887256 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.898910 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.910351 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.922386 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:37:18.934781 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:19.051056 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:37:19.172682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:19.643904 run create_hlr_db(pid=9262): Launched 04:37:19.767990 bus /sierra_2: Setting Powered False 04:37:20.828779 run create_hlr_db(pid=9262): Terminated: ok {rc=0} 04:37:21.269357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9264): Launched 04:37:21.593222 run osmo-hlr_10.42.42.2(pid=9265): Launched 04:37:21.717590 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:22.279105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9267): Launched 04:37:22.603989 run osmo-stp_10.42.42.5(pid=9268): Launched 04:37:22.727725 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:23.314051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9270): Launched 04:37:23.638417 run osmo-msc_10.42.42.6(pid=9271): Launched 04:37:23.820636 run osmo-stp_10.42.42.5(pid=9268): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9268)] 04:37:23.957829 run osmo-stp_10.42.42.5(pid=9268): stdout: | (launched: 2022-12-14_04:37:22.543506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:24.095423 run osmo-stp_10.42.42.5(pid=9268): stderr: | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043722734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:24.231469 run osmo-stp_10.42.42.5(pid=9268): stdout: | (launched: 2022-12-14_04:37:22.543506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:24.360276 run osmo-stp_10.42.42.5(pid=9268): stderr: | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043722734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043722734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043722735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:24.514550 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9268): Process ended prematurely: osmo-stp_10.42.42.5(pid=9268) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9268)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:37:24.524115 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:37:24.552224 run osmo-hlr_10.42.42.2(pid=9265): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9265)] 04:37:24.603190 run osmo-hlr_10.42.42.2(pid=9265): stdout: | (launched: 2022-12-14_04:37:21.533652) 04:37:24.655252 run osmo-hlr_10.42.42.2(pid=9265): stderr: | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043721731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043721746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043721756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043721756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043721756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:24.727948 run osmo-msc_10.42.42.6(pid=9271): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9271)] 04:37:24.777910 run osmo-msc_10.42.42.6(pid=9271): stdout: | (launched: 2022-12-14_04:37:23.578441) 04:37:24.830316 run osmo-msc_10.42.42.6(pid=9271): stderr: | [0;m[38;5;43m20221214043723899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043723900 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb344f32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043723900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043723900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043723900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043723900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043723902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043723902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043723903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043723903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:24.882547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9264): Terminating (SIGTERM) 04:37:24.924440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9267): Terminating (SIGTERM) 04:37:24.967103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9270): Terminating (SIGTERM) 04:37:25.009644 --- ParallelTerminationStrategy: PID 9264 died... 04:37:25.030350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9264): Terminated: ok {rc=0} 04:37:25.076753 --- ParallelTerminationStrategy: PID 9267 died... 04:37:25.096801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9267): Terminated: ok {rc=0} 04:37:25.143173 --- ParallelTerminationStrategy: PID 9270 died... 04:37:25.163194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9270): Terminated: ok {rc=0} 04:37:25.251493 bus /sierra_3: Setting Powered False 04:37:26.349865 bus /sierra_3: Setting Powered False 04:37:27.469838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:37:28.716281 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:28.724453 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:37:28.748783 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:37:28.777138 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:37:28.831532 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:37:28.856628 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:37:28.884448 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:37:29.439474 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:37:29.491730 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:29.503651 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:37:29.567163 tst mo_mt_call.py: using LAC 38596 04:37:29.692608 tst mo_mt_call.py: using RAC 91 04:37:29.817181 tst mo_mt_call.py: using CellId 38596 04:37:29.942081 tst mo_mt_call.py: using BVCI 38597 04:37:30.050959 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:30.062360 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:30.073523 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:30.084545 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:30.095781 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:30.106936 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:30.228200 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:30.347350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:30.866361 run create_hlr_db(pid=9276): Launched 04:37:31.035858 bus /sierra_2: Setting Powered False 04:37:32.099947 run create_hlr_db(pid=9276): Terminated: ok {rc=0} 04:37:32.526282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Launched 04:37:32.828931 run osmo-hlr_10.42.42.2(pid=9279): Launched 04:37:32.942434 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:33.476937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Launched 04:37:33.777655 run osmo-stp_10.42.42.5(pid=9282): Launched 04:37:33.892799 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:34.443272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Launched 04:37:34.744711 run osmo-msc_10.42.42.6(pid=9285): Launched 04:37:34.912932 run osmo-stp_10.42.42.5(pid=9282): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] 04:37:35.040031 run osmo-stp_10.42.42.5(pid=9282): stdout: | (launched: 2022-12-14_04:37:33.721604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:35.167598 run osmo-stp_10.42.42.5(pid=9282): stderr: | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043733893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:35.292902 run osmo-stp_10.42.42.5(pid=9282): stdout: | (launched: 2022-12-14_04:37:33.721604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:35.412100 run osmo-stp_10.42.42.5(pid=9282): stderr: | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043733892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043733893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043733893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:35.555009 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9282): Process ended prematurely: osmo-stp_10.42.42.5(pid=9282) [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:37:35.563934 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:37:35.590312 run osmo-hlr_10.42.42.2(pid=9279): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9279)] 04:37:35.637806 run osmo-hlr_10.42.42.2(pid=9279): stdout: | (launched: 2022-12-14_04:37:32.772714) 04:37:35.686959 run osmo-hlr_10.42.42.2(pid=9279): stderr: | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043732947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043732960 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043732971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043732971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043732971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:35.755663 run osmo-msc_10.42.42.6(pid=9285): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9285)] 04:37:35.803655 run osmo-msc_10.42.42.6(pid=9285): stdout: | (launched: 2022-12-14_04:37:34.688550) 04:37:35.852878 run osmo-msc_10.42.42.6(pid=9285): stderr: | [0;m[38;5;43m20221214043734959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043734959 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8befddfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043734959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043734959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043734959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043734959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043734961 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043734962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043734962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043734962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:35.902436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Terminating (SIGTERM) 04:37:35.942092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Terminating (SIGTERM) 04:37:35.981586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Terminating (SIGTERM) 04:37:36.021273 --- ParallelTerminationStrategy: PID 9278 died... 04:37:36.040421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Terminated: ok {rc=0} 04:37:36.084583 --- ParallelTerminationStrategy: PID 9281 died... 04:37:36.103246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Terminated: ok {rc=0} 04:37:36.146746 --- ParallelTerminationStrategy: PID 9284 died... 04:37:36.165353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Terminated: ok {rc=0} 04:37:36.250970 bus /sierra_3: Setting Powered False 04:37:37.352580 bus /sierra_3: Setting Powered False 04:37:38.468832 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:37:39.618661 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:39.631075 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:37:39.693382 tst mo_mt_call_osmux.py: using LAC 38597 04:37:39.812741 tst mo_mt_call_osmux.py: using RAC 92 04:37:39.933054 tst mo_mt_call_osmux.py: using CellId 38597 04:37:40.054557 tst mo_mt_call_osmux.py: using BVCI 38598 04:37:40.164893 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:40.176414 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:40.187688 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:40.199064 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:40.210481 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:37:40.221614 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:40.341709 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:37:40.462550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:40.963107 run create_hlr_db(pid=9287): Launched 04:37:41.087295 bus /sierra_2: Setting Powered False 04:37:42.150539 run create_hlr_db(pid=9287): Terminated: ok {rc=0} 04:37:42.581656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9289): Launched 04:37:42.882807 run osmo-hlr_10.42.42.2(pid=9290): Launched 04:37:42.996442 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:43.533912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9292): Launched 04:37:43.834768 run osmo-stp_10.42.42.5(pid=9293): Launched 04:37:43.950589 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:44.496265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9295): Launched 04:37:44.799876 run osmo-msc_10.42.42.6(pid=9296): Launched 04:37:44.968047 run osmo-stp_10.42.42.5(pid=9293): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9293)] 04:37:45.096148 run osmo-stp_10.42.42.5(pid=9293): stdout: | (launched: 2022-12-14_04:37:43.778734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:45.224004 run osmo-stp_10.42.42.5(pid=9293): stderr: | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043743951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:45.349167 run osmo-stp_10.42.42.5(pid=9293): stdout: | (launched: 2022-12-14_04:37:43.778734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:45.468455 run osmo-stp_10.42.42.5(pid=9293): stderr: | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043743950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043743951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043743951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:45.611559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9293): Process ended prematurely: osmo-stp_10.42.42.5(pid=9293) [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9293)] [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:37:45.620429 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 04:37:45.646639 run osmo-hlr_10.42.42.2(pid=9290): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9290)] 04:37:45.693804 run osmo-hlr_10.42.42.2(pid=9290): stdout: | (launched: 2022-12-14_04:37:42.826786) 04:37:45.742672 run osmo-hlr_10.42.42.2(pid=9290): stderr: | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043743014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043743023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043743024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043743024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:45.811200 run osmo-msc_10.42.42.6(pid=9296): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9296)] 04:37:45.867602 run osmo-msc_10.42.42.6(pid=9296): stdout: | (launched: 2022-12-14_04:37:44.742631) 04:37:45.922165 run osmo-msc_10.42.42.6(pid=9296): stderr: | [0;m[38;5;43m20221214043745012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043745012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe94994ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043745012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043745012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043745013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043745013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043745014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043745015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043745015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043745015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:45.973048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9289): Terminating (SIGTERM) 04:37:46.013060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9292): Terminating (SIGTERM) 04:37:46.053121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9295): Terminating (SIGTERM) 04:37:46.094165 --- ParallelTerminationStrategy: PID 9289 died... 04:37:46.113582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9289): Terminated: ok {rc=0} 04:37:46.159543 --- ParallelTerminationStrategy: PID 9292 died... 04:37:46.178899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9292): Terminated: ok {rc=0} 04:37:46.223562 --- ParallelTerminationStrategy: PID 9295 died... 04:37:46.242852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9295): Terminated: ok {rc=0} 04:37:46.328754 bus /sierra_3: Setting Powered False 04:37:47.425662 bus /sierra_3: Setting Powered False 04:37:48.538436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:nanobts+band-1900 --------------------------------------------------------------------- 04:37:49.782637 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:37:49.788323 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:37:49.811991 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 04:37:49.840055 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:37:49.925777 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:37:49.949447 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 04:37:49.976589 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:37:50.560259 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 04:37:50.565451 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:50.576359 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:37:50.616225 tst emergency_mo_mt_call.py: using LAC 38598 04:37:50.732419 tst emergency_mo_mt_call.py: using RAC 93 04:37:50.857359 tst emergency_mo_mt_call.py: using CellId 38598 04:37:50.983284 tst emergency_mo_mt_call.py: using BVCI 38599 04:37:51.100011 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:51.111307 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:51.122605 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:51.133634 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:51.145003 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:37:51.156295 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:51.271320 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:37:51.390903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:37:51.882512 run create_hlr_db(pid=9301): Launched 04:37:52.022050 bus /sierra_2: Setting Powered False 04:37:53.085629 run create_hlr_db(pid=9301): Terminated: ok {rc=0} 04:37:53.510311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Launched 04:37:53.806011 run osmo-hlr_10.42.42.2(pid=9304): Launched 04:37:53.917142 run osmo-stp_10.42.42.5: Starting osmo-stp 04:37:54.426851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Launched 04:37:54.722317 run osmo-stp_10.42.42.5(pid=9307): Launched 04:37:54.844062 tst emergency_mo_mt_call.py: using MSISDN 8504 04:37:54.994011 run osmo-msc_10.42.42.6: Starting osmo-msc 04:37:55.527490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Launched 04:37:55.822230 run osmo-msc_10.42.42.6(pid=9310): Launched 04:37:55.986535 run osmo-stp_10.42.42.5(pid=9307): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] 04:37:56.112164 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-14_04:37:54.666822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:56.237601 run osmo-stp_10.42.42.5(pid=9307): stderr: | [0;m[38;5;43m20221214043754836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043754837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043754837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043754837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:56.360671 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-14_04:37:54.666822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:37:56.477659 run osmo-stp_10.42.42.5(pid=9307): stderr: | [0;m[38;5;43m20221214043754836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043754837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043754837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043754837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043754838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:37:56.617819 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 04:37:56.625912 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 04:37:56.651745 run osmo-hlr_10.42.42.2(pid=9304): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9304)] 04:37:56.699988 run osmo-hlr_10.42.42.2(pid=9304): stdout: | (launched: 2022-12-14_04:37:53.751069) 04:37:56.749460 run osmo-hlr_10.42.42.2(pid=9304): stderr: | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043753925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043753937 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043753946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043753947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043753947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:37:56.818789 run osmo-msc_10.42.42.6(pid=9310): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9310)] 04:37:56.866587 run osmo-msc_10.42.42.6(pid=9310): stdout: | (launched: 2022-12-14_04:37:55.767001) 04:37:56.915954 run osmo-msc_10.42.42.6(pid=9310): stderr: | [0;m[38;5;43m20221214043756036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043756036 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f534f74ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043756036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043756036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043756037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043756037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043756039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043756039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043756039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043756039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:37:56.965595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminating (SIGTERM) 04:37:57.005280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminating (SIGTERM) 04:37:57.044845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminating (SIGTERM) 04:37:57.084491 --- ParallelTerminationStrategy: PID 9303 died... 04:37:57.103669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminated: ok {rc=0} 04:37:57.147786 --- ParallelTerminationStrategy: PID 9306 died... 04:37:57.166360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminated: ok {rc=0} 04:37:57.210080 --- ParallelTerminationStrategy: PID 9309 died... 04:37:57.228814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminated: ok {rc=0} 04:37:57.315702 bus /sierra_3: Setting Powered False 04:37:58.415523 bus /sierra_3: Setting Powered False 04:37:59.530289 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 04:38:00.616468 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:00.628421 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:00.671208 tst emergency_preemptive_call.py: using LAC 38599 04:38:00.788404 tst emergency_preemptive_call.py: using RAC 94 04:38:00.927221 tst emergency_preemptive_call.py: using CellId 38599 04:38:01.051672 tst emergency_preemptive_call.py: using BVCI 38600 04:38:01.170529 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:01.182939 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:01.195363 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:01.208587 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:01.222694 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 04:38:01.235949 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:01.371176 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:01.490072 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:01.627735 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:01.769828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:02.280225 run create_hlr_db(pid=9312): Launched 04:38:02.401991 bus /sierra_2: Setting Powered False 04:38:03.461248 run create_hlr_db(pid=9312): Terminated: ok {rc=0} 04:38:03.876596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Launched 04:38:04.174040 run osmo-hlr_10.42.42.2(pid=9315): Launched 04:38:04.287704 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:04.816385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Launched 04:38:05.113207 run osmo-stp_10.42.42.5(pid=9318): Launched 04:38:05.233406 tst emergency_preemptive_call.py: using MSISDN 8505 04:38:05.383508 run osmo-msc_10.42.42.6: Starting osmo-msc 04:38:05.915927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Launched 04:38:06.212357 run osmo-msc_10.42.42.6(pid=9321): Launched 04:38:06.376519 run osmo-stp_10.42.42.5(pid=9318): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] 04:38:06.501500 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-14_04:38:05.057622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:06.626650 run osmo-stp_10.42.42.5(pid=9318): stderr: | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043805228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:06.749822 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-14_04:38:05.057622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:06.866882 run osmo-stp_10.42.42.5(pid=9318): stderr: | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043805228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043805228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043805229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:07.007363 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 04:38:07.015566 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 04:38:07.041819 run osmo-hlr_10.42.42.2(pid=9315): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9315)] 04:38:07.089887 run osmo-hlr_10.42.42.2(pid=9315): stdout: | (launched: 2022-12-14_04:38:04.118673) 04:38:07.139284 run osmo-hlr_10.42.42.2(pid=9315): stderr: | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043804295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043804306 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043804315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043804315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043804315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:07.208882 run osmo-msc_10.42.42.6(pid=9321): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9321)] 04:38:07.256459 run osmo-msc_10.42.42.6(pid=9321): stdout: | (launched: 2022-12-14_04:38:06.157067) 04:38:07.305918 run osmo-msc_10.42.42.6(pid=9321): stderr: | [0;m[38;5;43m20221214043806427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214043806428 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f614d161c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214043806428 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214043806428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214043806428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214043806428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214043806430 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214043806430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214043806431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214043806431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:38:07.355705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminating (SIGTERM) 04:38:07.395392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminating (SIGTERM) 04:38:07.435287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminating (SIGTERM) 04:38:07.475352 --- ParallelTerminationStrategy: PID 9314 died... 04:38:07.494678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminated: ok {rc=0} 04:38:07.538704 --- ParallelTerminationStrategy: PID 9317 died... 04:38:07.557424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminated: ok {rc=0} 04:38:07.601282 --- ParallelTerminationStrategy: PID 9320 died... 04:38:07.619915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminated: ok {rc=0} 04:38:07.703865 bus /sierra_9: Setting Powered False 04:38:08.802675 bus /sierra_9: Setting Powered False 04:38:09.920310 bus /sierra_8: Setting Powered False 04:38:11.020484 bus /sierra_8: Setting Powered False 04:38:12.135544 bus /sierra_3: Setting Powered False 04:38:13.236014 bus /sierra_3: Setting Powered False 04:38:14.354743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900 --------------------------------------------------------------------- 04:38:15.625376 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:38:15.630456 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 04:38:15.653898 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 04:38:15.692037 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 04:38:15.778165 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 04:38:15.801643 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 04:38:15.846983 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 04:38:16.433561 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 04:38:16.485570 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:16.496925 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:16.535311 tst cs_paging_gprs_active.py: using LAC 38600 04:38:16.666767 tst cs_paging_gprs_active.py: using RAC 95 04:38:16.788093 tst cs_paging_gprs_active.py: using CellId 38600 04:38:16.910410 tst cs_paging_gprs_active.py: using BVCI 38601 04:38:17.022937 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.034389 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.045680 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.056906 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.068159 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.079204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.090292 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.101344 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:17.112457 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:17.232739 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:17.349263 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:38:17.551864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:17.855574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Launched 04:38:18.118978 run iperf3-srv_10.42.42.10(pid=9328): Launched 04:38:18.232544 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:38:18.434140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:18.737674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Launched 04:38:19.002585 run iperf3-srv_10.42.42.10(pid=9330): Launched 04:38:19.115317 tst cs_paging_gprs_active.py:38: start network... 04:38:19.316272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:19.785688 run create_hlr_db(pid=9331): Launched 04:38:19.912763 bus /sierra_2: Setting Powered False 04:38:20.973548 run create_hlr_db(pid=9331): Terminated: ok {rc=0} 04:38:21.414930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Launched 04:38:21.740515 run osmo-hlr_10.42.42.2(pid=9334): Launched 04:38:21.863932 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:22.424565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Launched 04:38:22.750537 run osmo-stp_10.42.42.5(pid=9337): Launched 04:38:22.875318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:23.436182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Launched 04:38:23.562474 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:23.837591 run patchelf(pid=9340): Launched 04:38:24.018041 run osmo-stp_10.42.42.5(pid=9337): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] 04:38:24.146974 run osmo-stp_10.42.42.5(pid=9337): stdout: | (launched: 2022-12-14_04:38:22.690633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:24.277483 run osmo-stp_10.42.42.5(pid=9337): stderr: | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043822883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:24.407497 run osmo-stp_10.42.42.5(pid=9337): stdout: | (launched: 2022-12-14_04:38:22.690633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:24.532062 run osmo-stp_10.42.42.5(pid=9337): stderr: | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043822883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043822883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043822884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:24.679777 run patchelf(pid=9340): Terminating (SIGINT) 04:38:24.849910 run patchelf(pid=9340): Terminated: ok {rc=0} 04:38:24.973176 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9337): Process ended prematurely: osmo-stp_10.42.42.5(pid=9337) [trial-2399↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] [trial-2399↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 04:38:24.982764 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:38:25.010208 run osmo-hlr_10.42.42.2(pid=9334): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9334)] 04:38:25.058142 run osmo-hlr_10.42.42.2(pid=9334): stdout: | (launched: 2022-12-14_04:38:21.680481) 04:38:25.107525 run osmo-hlr_10.42.42.2(pid=9334): stderr: | [0;m[1;31m20221214043821876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043821876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043821876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043821876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043821876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043821877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043821888 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043821898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043821898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043821898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:25.157353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Terminating (SIGTERM) 04:38:25.196896 run iperf3-srv_10.42.42.10(pid=9328): Terminating (SIGTERM) 04:38:25.236151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Terminating (SIGTERM) 04:38:25.275699 run iperf3-srv_10.42.42.10(pid=9330): Terminating (SIGTERM) 04:38:25.315150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Terminating (SIGTERM) 04:38:25.354744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Terminating (SIGTERM) 04:38:25.394122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Terminating (SIGTERM) 04:38:25.434422 --- ParallelTerminationStrategy: PID 9327 died... 04:38:25.453505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9327): Terminated: ok {rc=0} 04:38:25.497526 --- ParallelTerminationStrategy: PID 9328 died... 04:38:25.515996 run iperf3-srv_10.42.42.10(pid=9328): Terminated {rc=256} 04:38:25.559655 --- ParallelTerminationStrategy: PID 9329 died... 04:38:25.578544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9329): Terminated: ok {rc=0} 04:38:25.622034 --- ParallelTerminationStrategy: PID 9330 died... 04:38:25.640643 run iperf3-srv_10.42.42.10(pid=9330): Terminated {rc=256} 04:38:25.684220 --- ParallelTerminationStrategy: PID 9333 died... 04:38:25.702932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9333): Terminated: ok {rc=0} 04:38:25.746647 --- ParallelTerminationStrategy: PID 9336 died... 04:38:25.765346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9336): Terminated: ok {rc=0} 04:38:25.809145 --- ParallelTerminationStrategy: PID 9339 died... 04:38:25.827765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9339): Terminated: ok {rc=0} 04:38:25.911562 bus /gobi_0: Setting Powered False 04:38:27.007468 bus /gobi_0: Setting Powered False 04:38:28.120771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 04:38:29.269489 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.281381 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:29.321074 tst iperf3.py: using LAC 38601 04:38:29.441117 tst iperf3.py: using RAC 96 04:38:29.559952 tst iperf3.py: using CellId 38601 04:38:29.689383 tst iperf3.py: using BVCI 38602 04:38:29.807833 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.819326 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.830637 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.841950 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.853639 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.865332 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.877047 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.888448 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:29.900177 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:30.019492 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:30.220737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:30.523671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Launched 04:38:30.786307 run iperf3-srv_10.42.42.10(pid=9342): Launched 04:38:30.902423 tst iperf3.py:8: start network... 04:38:31.106973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:31.584766 run create_hlr_db(pid=9343): Launched 04:38:31.744842 bus /gobi_6: Setting Powered False 04:38:32.809068 run create_hlr_db(pid=9343): Terminated: ok {rc=0} 04:38:33.259602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Launched 04:38:33.585454 run osmo-hlr_10.42.42.2(pid=9346): Launched 04:38:33.709308 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:34.268342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Launched 04:38:34.591333 run osmo-stp_10.42.42.5(pid=9349): Launched 04:38:34.714596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:35.275408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Launched 04:38:35.401660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:35.676233 run patchelf(pid=9352): Launched 04:38:35.858277 run osmo-stp_10.42.42.5(pid=9349): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] 04:38:35.995978 run osmo-stp_10.42.42.5(pid=9349): stdout: | (launched: 2022-12-14_04:38:34.531468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:36.135112 run osmo-stp_10.42.42.5(pid=9349): stderr: | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043834723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:36.274592 run osmo-stp_10.42.42.5(pid=9349): stdout: | (launched: 2022-12-14_04:38:34.531468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:36.408136 run osmo-stp_10.42.42.5(pid=9349): stderr: | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043834722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043834723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043834723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:36.566262 run patchelf(pid=9352): Terminating (SIGINT) 04:38:36.748081 run patchelf(pid=9352): Terminated: ok {rc=0} 04:38:36.879319 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9349): Process ended prematurely: osmo-stp_10.42.42.5(pid=9349) [trial-2399↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] [trial-2399↪gprs:nanobts+band-1900↪iperf3.py:8] 04:38:36.889704 tst iperf3.py:8: Test FAILED (7.7 sec) 04:38:36.918502 run osmo-hlr_10.42.42.2(pid=9346): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9346)] 04:38:36.969719 run osmo-hlr_10.42.42.2(pid=9346): stdout: | (launched: 2022-12-14_04:38:33.525416) 04:38:37.022973 run osmo-hlr_10.42.42.2(pid=9346): stderr: | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043833722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043833738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043833748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043833748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043833748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:37.076066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Terminating (SIGTERM) 04:38:37.118081 run iperf3-srv_10.42.42.10(pid=9342): Terminating (SIGTERM) 04:38:37.160384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Terminating (SIGTERM) 04:38:37.202872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Terminating (SIGTERM) 04:38:37.245246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Terminating (SIGTERM) 04:38:37.287946 --- ParallelTerminationStrategy: PID 9341 died... 04:38:37.308377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9341): Terminated: ok {rc=0} 04:38:37.355306 --- ParallelTerminationStrategy: PID 9342 died... 04:38:37.375518 run iperf3-srv_10.42.42.10(pid=9342): Terminated {rc=256} 04:38:37.422098 --- ParallelTerminationStrategy: PID 9345 died... 04:38:37.442329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9345): Terminated: ok {rc=0} 04:38:37.488656 --- ParallelTerminationStrategy: PID 9348 died... 04:38:37.508558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9348): Terminated: ok {rc=0} 04:38:37.555251 --- ParallelTerminationStrategy: PID 9351 died... 04:38:37.575604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9351): Terminated: ok {rc=0} 04:38:37.664902 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 04:38:38.813960 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:38.826014 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:38.865936 tst iperf3m4.py: using LAC 38602 04:38:38.994738 tst iperf3m4.py: using RAC 97 04:38:39.123227 tst iperf3m4.py: using CellId 38602 04:38:39.249447 tst iperf3m4.py: using BVCI 38603 04:38:39.366559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.377985 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.389314 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.400532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.411863 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.423382 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.434911 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.446374 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:39.458128 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:39.574820 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:39.696920 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:39.812294 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:39.925837 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:38:40.126991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:40.431149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Launched 04:38:40.692940 run iperf3-srv_10.42.42.10(pid=9354): Launched 04:38:40.805413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:38:41.006031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:41.308728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Launched 04:38:41.571015 run iperf3-srv_10.42.42.10(pid=9356): Launched 04:38:41.683797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:38:41.883918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:42.186649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Launched 04:38:42.450973 run iperf3-srv_10.42.42.10(pid=9358): Launched 04:38:42.564839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:38:42.765275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:38:43.067806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Launched 04:38:43.331879 run iperf3-srv_10.42.42.10(pid=9360): Launched 04:38:43.444627 tst iperf3m4.py:8: start network... 04:38:43.645077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:38:44.114823 run create_hlr_db(pid=9361): Launched 04:38:44.237721 bus /gobi_6: Setting Powered False 04:38:45.298539 run create_hlr_db(pid=9361): Terminated: ok {rc=0} 04:38:45.740796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Launched 04:38:46.073677 run osmo-hlr_10.42.42.2(pid=9364): Launched 04:38:46.321134 run osmo-stp_10.42.42.5: Starting osmo-stp 04:38:47.001981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Launched 04:38:47.359804 run osmo-stp_10.42.42.5(pid=9367): Launched 04:38:47.484297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:38:48.047374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Launched 04:38:48.173215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:38:48.448331 run patchelf(pid=9370): Launched 04:38:48.632079 run osmo-stp_10.42.42.5(pid=9367): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] 04:38:48.769525 run osmo-stp_10.42.42.5(pid=9367): stdout: | (launched: 2022-12-14_04:38:47.299003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:48.908092 run osmo-stp_10.42.42.5(pid=9367): stderr: | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043847489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:49.047724 run osmo-stp_10.42.42.5(pid=9367): stdout: | (launched: 2022-12-14_04:38:47.299003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:38:49.180833 run osmo-stp_10.42.42.5(pid=9367): stderr: | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043847488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043847489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043847489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:38:49.338319 run patchelf(pid=9370): Terminating (SIGINT) 04:38:49.520173 run patchelf(pid=9370): Terminated: ok {rc=0} 04:38:49.651206 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9367): Process ended prematurely: osmo-stp_10.42.42.5(pid=9367) [trial-2399↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] [trial-2399↪gprs:nanobts+band-1900↪iperf3m4.py:8] 04:38:49.661635 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:38:49.690507 run osmo-hlr_10.42.42.2(pid=9364): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9364)] 04:38:49.741248 run osmo-hlr_10.42.42.2(pid=9364): stdout: | (launched: 2022-12-14_04:38:46.012476) 04:38:49.793593 run osmo-hlr_10.42.42.2(pid=9364): stderr: | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043846308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043846365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043846374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043846374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043846374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:38:49.845900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Terminating (SIGTERM) 04:38:49.887619 run iperf3-srv_10.42.42.10(pid=9354): Terminating (SIGTERM) 04:38:49.929878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Terminating (SIGTERM) 04:38:49.971920 run iperf3-srv_10.42.42.10(pid=9356): Terminating (SIGTERM) 04:38:50.014180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Terminating (SIGTERM) 04:38:50.056526 run iperf3-srv_10.42.42.10(pid=9358): Terminating (SIGTERM) 04:38:50.098675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Terminating (SIGTERM) 04:38:50.140772 run iperf3-srv_10.42.42.10(pid=9360): Terminating (SIGTERM) 04:38:50.182718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Terminating (SIGTERM) 04:38:50.224873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Terminating (SIGTERM) 04:38:50.266969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Terminating (SIGTERM) 04:38:50.309307 --- ParallelTerminationStrategy: PID 9353 died... 04:38:50.330173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9353): Terminated: ok {rc=0} 04:38:50.376939 --- ParallelTerminationStrategy: PID 9354 died... 04:38:50.397260 run iperf3-srv_10.42.42.10(pid=9354): Terminated {rc=256} 04:38:50.443973 --- ParallelTerminationStrategy: PID 9355 died... 04:38:50.464303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9355): Terminated: ok {rc=0} 04:38:50.511157 --- ParallelTerminationStrategy: PID 9356 died... 04:38:50.531306 run iperf3-srv_10.42.42.10(pid=9356): Terminated {rc=256} 04:38:50.577919 --- ParallelTerminationStrategy: PID 9357 died... 04:38:50.598035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9357): Terminated: ok {rc=0} 04:38:50.644507 --- ParallelTerminationStrategy: PID 9358 died... 04:38:50.664620 run iperf3-srv_10.42.42.10(pid=9358): Terminated {rc=256} 04:38:50.711210 --- ParallelTerminationStrategy: PID 9359 died... 04:38:50.731342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9359): Terminated: ok {rc=0} 04:38:50.778005 --- ParallelTerminationStrategy: PID 9360 died... 04:38:50.797979 run iperf3-srv_10.42.42.10(pid=9360): Terminated {rc=256} 04:38:50.844574 --- ParallelTerminationStrategy: PID 9363 died... 04:38:50.864774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9363): Terminated: ok {rc=0} 04:38:50.911377 --- ParallelTerminationStrategy: PID 9366 died... 04:38:50.931615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9366): Terminated: ok {rc=0} 04:38:50.978250 --- ParallelTerminationStrategy: PID 9369 died... 04:38:50.998637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9369): Terminated: ok {rc=0} 04:38:51.087137 bus /gobi_4: Setting Powered False 04:38:52.186902 bus /gobi_4: Setting Powered False 04:38:53.303941 bus /gobi_1: Setting Powered False 04:38:54.402754 bus /gobi_1: Setting Powered False 04:38:55.519443 bus /gobi_0: Setting Powered False 04:38:56.618011 bus /gobi_0: Setting Powered False 04:38:57.736782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 04:38:58.838901 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:58.850507 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:38:58.888931 tst ping.py: using LAC 38603 04:38:59.004752 tst ping.py: using RAC 98 04:38:59.130023 tst ping.py: using CellId 38603 04:38:59.256257 tst ping.py: using BVCI 38604 04:38:59.371563 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.382810 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.393984 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.405006 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.416158 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.427449 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.438856 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:38:59.450209 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:38:59.564807 tst ping.py:19: start network... 04:38:59.762238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:00.220569 run create_hlr_db(pid=9371): Launched 04:39:00.343754 bus /gobi_6: Setting Powered False 04:39:01.405778 run create_hlr_db(pid=9371): Terminated: ok {rc=0} 04:39:01.963031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9409): Launched 04:39:02.338220 run osmo-hlr_10.42.42.2(pid=9422): Launched 04:39:02.643762 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:03.363247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Launched 04:39:03.753922 run osmo-stp_10.42.42.5(pid=9540): Launched 04:39:03.997068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:04.747472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9648): Launched 04:39:04.886805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:05.161280 run patchelf(pid=9649): Launched 04:39:05.353220 run osmo-stp_10.42.42.5(pid=9540): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] 04:39:05.492386 run osmo-stp_10.42.42.5(pid=9540): stdout: | (launched: 2022-12-14_04:39:03.681734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:05.633477 run osmo-stp_10.42.42.5(pid=9540): stderr: | [0;m[38;5;43m20221214043904032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043904032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043904037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043904038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:05.775389 run osmo-stp_10.42.42.5(pid=9540): stdout: | (launched: 2022-12-14_04:39:03.681734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:05.909187 run osmo-stp_10.42.42.5(pid=9540): stderr: | [0;m[38;5;43m20221214043904032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043904032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043904037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043904038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043904038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:06.068524 run patchelf(pid=9649): Terminating (SIGINT) 04:39:06.250892 run patchelf(pid=9649): Terminated: ok {rc=0} 04:39:06.382455 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9540): Process ended prematurely: osmo-stp_10.42.42.5(pid=9540) [trial-2399↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] [trial-2399↪gprs:nanobts+band-1900↪ping.py:22] 04:39:06.392335 tst ping.py:22: Test FAILED (7.5 sec) 04:39:06.421418 run osmo-hlr_10.42.42.2(pid=9422): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9422)] 04:39:06.476800 run osmo-hlr_10.42.42.2(pid=9422): stdout: | (launched: 2022-12-14_04:39:02.262759) 04:39:06.531908 run osmo-hlr_10.42.42.2(pid=9422): stderr: | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043902554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043902571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043902584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:06.587614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9409): Terminating (SIGTERM) 04:39:06.632116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Terminating (SIGTERM) 04:39:06.679484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9648): Terminating (SIGTERM) 04:39:06.726610 --- ParallelTerminationStrategy: PID 9409 died... 04:39:06.748496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9409): Terminated: ok {rc=0} 04:39:06.799794 --- ParallelTerminationStrategy: PID 9490 died... 04:39:06.820323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Terminated: ok {rc=0} 04:39:06.869217 --- ParallelTerminationStrategy: PID 9648 died... 04:39:06.890938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9648): Terminated: ok {rc=0} 04:39:06.986688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 04:39:08.079866 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.092902 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 04:39:08.134759 tst ping_idle_ping.py: using LAC 38604 04:39:08.261877 tst ping_idle_ping.py: using RAC 99 04:39:08.388453 tst ping_idle_ping.py: using CellId 38604 04:39:08.514607 tst ping_idle_ping.py: using BVCI 38605 04:39:08.633921 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.646374 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.658567 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.671115 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.684137 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.697230 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.710485 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 04:39:08.723605 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 04:39:08.849537 tst ping_idle_ping.py:24: start network... 04:39:09.068698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:09.575479 run create_hlr_db(pid=9652): Launched 04:39:09.728936 bus /gobi_6: Setting Powered False 04:39:10.794609 run create_hlr_db(pid=9652): Terminated: ok {rc=0} 04:39:11.252941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9654): Launched 04:39:11.594374 run osmo-hlr_10.42.42.2(pid=9655): Launched 04:39:11.844465 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:12.507679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9657): Launched 04:39:12.850418 run osmo-stp_10.42.42.5(pid=9658): Launched 04:39:13.096066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:13.737950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9660): Launched 04:39:13.875263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:14.154218 run patchelf(pid=9661): Launched 04:39:14.351184 run osmo-stp_10.42.42.5(pid=9658): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9658)] 04:39:14.492365 run osmo-stp_10.42.42.5(pid=9658): stdout: | (launched: 2022-12-14_04:39:12.789693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:14.635762 run osmo-stp_10.42.42.5(pid=9658): stderr: | [0;m[38;5;43m20221214043913077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043913078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043913078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043913078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:14.777966 run osmo-stp_10.42.42.5(pid=9658): stdout: | (launched: 2022-12-14_04:39:12.789693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:14.914689 run osmo-stp_10.42.42.5(pid=9658): stderr: | [0;m[38;5;43m20221214043913077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043913078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043913078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043913078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043913079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:15.079302 run patchelf(pid=9661): Terminating (SIGINT) 04:39:15.264355 run patchelf(pid=9661): Terminated: ok {rc=0} 04:39:15.399313 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9658): Process ended prematurely: osmo-stp_10.42.42.5(pid=9658) [trial-2399↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9658)] [trial-2399↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 04:39:15.411314 tst ping_idle_ping.py:27: Test FAILED (7.3 sec) 04:39:15.440996 run osmo-hlr_10.42.42.2(pid=9655): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9655)] 04:39:15.496000 run osmo-hlr_10.42.42.2(pid=9655): stdout: | (launched: 2022-12-14_04:39:11.531736) 04:39:15.551161 run osmo-hlr_10.42.42.2(pid=9655): stderr: | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043911840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043911876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043911884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043911889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043911889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:15.607148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9654): Terminating (SIGTERM) 04:39:15.653849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9657): Terminating (SIGTERM) 04:39:15.702390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9660): Terminating (SIGTERM) 04:39:15.749486 --- ParallelTerminationStrategy: PID 9654 died... 04:39:15.771899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9654): Terminated: ok {rc=0} 04:39:15.824897 --- ParallelTerminationStrategy: PID 9657 died... 04:39:15.854454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9657): Terminated: ok {rc=0} 04:39:15.917983 --- ParallelTerminationStrategy: PID 9660 died... 04:39:15.939540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9660): Terminated: ok {rc=0} 04:39:16.067652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 04:39:17.440157 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:39:17.448215 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:39:17.474141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:39:17.522397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:39:17.614934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:39:17.640607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:39:17.684336 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:39:18.277639 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:39:18.335538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.348209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:18.394946 tst cs_paging_gprs_active.py: using LAC 38605 04:39:18.526230 tst cs_paging_gprs_active.py: using RAC 100 04:39:18.657509 tst cs_paging_gprs_active.py: using CellId 38605 04:39:18.786396 tst cs_paging_gprs_active.py: using BVCI 38606 04:39:18.910829 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.923394 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.935873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.948508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.962119 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.975491 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:18.990252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:19.002864 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:19.018720 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:19.144582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:19.271979 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:39:19.501170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:19.845723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9666): Launched 04:39:20.151698 run iperf3-srv_10.42.42.10(pid=9667): Launched 04:39:20.292347 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:39:20.520388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:20.861532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9668): Launched 04:39:21.168693 run iperf3-srv_10.42.42.10(pid=9669): Launched 04:39:21.310341 tst cs_paging_gprs_active.py:38: start network... 04:39:21.538944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:22.064059 run create_hlr_db(pid=9670): Launched 04:39:22.231874 bus /gobi_6: Setting Powered False 04:39:23.298170 run create_hlr_db(pid=9670): Terminated: ok {rc=0} 04:39:23.770733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9672): Launched 04:39:24.122826 run osmo-hlr_10.42.42.2(pid=9673): Launched 04:39:24.374640 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:25.052178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9675): Launched 04:39:25.401492 run osmo-stp_10.42.42.5(pid=9676): Launched 04:39:25.652791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:26.268111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9680): Launched 04:39:26.383546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:26.640402 run patchelf(pid=9681): Launched 04:39:26.811049 run osmo-stp_10.42.42.5(pid=9676): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9676)] 04:39:26.939380 run osmo-stp_10.42.42.5(pid=9676): stdout: | (launched: 2022-12-14_04:39:25.340393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:27.069379 run osmo-stp_10.42.42.5(pid=9676): stderr: | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043925645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:27.199466 run osmo-stp_10.42.42.5(pid=9676): stdout: | (launched: 2022-12-14_04:39:25.340393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:27.323889 run osmo-stp_10.42.42.5(pid=9676): stderr: | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043925645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043925646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:27.471184 run patchelf(pid=9681): Terminating (SIGINT) 04:39:27.640537 run patchelf(pid=9681): Terminated: ok {rc=0} 04:39:27.763271 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9676): Process ended prematurely: osmo-stp_10.42.42.5(pid=9676) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9676)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:39:27.772757 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 04:39:27.799878 run osmo-hlr_10.42.42.2(pid=9673): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9673)] 04:39:27.847072 run osmo-hlr_10.42.42.2(pid=9673): stdout: | (launched: 2022-12-14_04:39:24.058844) 04:39:27.896054 run osmo-hlr_10.42.42.2(pid=9673): stderr: | [0;m[1;31m20221214043924363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043924364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043924364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043924364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043924364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043924364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043924383 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043924396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043924396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043924396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:27.945581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9666): Terminating (SIGTERM) 04:39:27.984890 run iperf3-srv_10.42.42.10(pid=9667): Terminating (SIGTERM) 04:39:28.024344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9668): Terminating (SIGTERM) 04:39:28.063798 run iperf3-srv_10.42.42.10(pid=9669): Terminating (SIGTERM) 04:39:28.103021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9672): Terminating (SIGTERM) 04:39:28.142590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9675): Terminating (SIGTERM) 04:39:28.181846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9680): Terminating (SIGTERM) 04:39:28.221506 --- ParallelTerminationStrategy: PID 9666 died... 04:39:28.240336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9666): Terminated: ok {rc=0} 04:39:28.284568 --- ParallelTerminationStrategy: PID 9667 died... 04:39:28.303375 run iperf3-srv_10.42.42.10(pid=9667): Terminated {rc=256} 04:39:28.346759 --- ParallelTerminationStrategy: PID 9668 died... 04:39:28.365251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9668): Terminated: ok {rc=0} 04:39:28.408647 --- ParallelTerminationStrategy: PID 9669 died... 04:39:28.427191 run iperf3-srv_10.42.42.10(pid=9669): Terminated {rc=256} 04:39:28.470707 --- ParallelTerminationStrategy: PID 9672 died... 04:39:28.489224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9672): Terminated: ok {rc=0} 04:39:28.532556 --- ParallelTerminationStrategy: PID 9675 died... 04:39:28.551156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9675): Terminated: ok {rc=0} 04:39:28.594589 --- ParallelTerminationStrategy: PID 9680 died... 04:39:28.613179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9680): Terminated: ok {rc=0} 04:39:28.697862 bus /gobi_0: Setting Powered False 04:39:29.797987 bus /gobi_0: Setting Powered False 04:39:30.934477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:39:32.092519 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.105965 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:32.151868 tst iperf3.py: using LAC 38606 04:39:32.282229 tst iperf3.py: using RAC 101 04:39:32.412376 tst iperf3.py: using CellId 38606 04:39:32.539862 tst iperf3.py: using BVCI 38607 04:39:32.658497 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.670039 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.681696 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.692823 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.704264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.715662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.727324 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.738833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:32.750523 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:32.870964 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:33.090496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:33.418597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9682): Launched 04:39:33.704012 run iperf3-srv_10.42.42.10(pid=9683): Launched 04:39:33.827763 tst iperf3.py:8: start network... 04:39:34.046809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:34.553534 run create_hlr_db(pid=9684): Launched 04:39:34.677618 bus /gobi_6: Setting Powered False 04:39:35.741638 run create_hlr_db(pid=9684): Terminated: ok {rc=0} 04:39:36.178369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9686): Launched 04:39:36.486094 run osmo-hlr_10.42.42.2(pid=9687): Launched 04:39:36.605486 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:37.151966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9689): Launched 04:39:37.456602 run osmo-stp_10.42.42.5(pid=9690): Launched 04:39:37.574090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:38.100775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9692): Launched 04:39:38.218365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:38.475545 run patchelf(pid=9693): Launched 04:39:38.645933 run osmo-stp_10.42.42.5(pid=9690): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9690)] 04:39:38.774125 run osmo-stp_10.42.42.5(pid=9690): stdout: | (launched: 2022-12-14_04:39:37.399361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:38.904697 run osmo-stp_10.42.42.5(pid=9690): stderr: | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043937573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:39.034671 run osmo-stp_10.42.42.5(pid=9690): stdout: | (launched: 2022-12-14_04:39:37.399361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:39.158780 run osmo-stp_10.42.42.5(pid=9690): stderr: | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043937572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043937573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043937573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:39.305663 run patchelf(pid=9693): Terminating (SIGINT) 04:39:39.475640 run patchelf(pid=9693): Terminated: ok {rc=0} 04:39:39.597834 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9690): Process ended prematurely: osmo-stp_10.42.42.5(pid=9690) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9690)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 04:39:39.607390 tst iperf3.py:8: Test FAILED (7.6 sec) 04:39:39.634609 run osmo-hlr_10.42.42.2(pid=9687): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9687)] 04:39:39.682262 run osmo-hlr_10.42.42.2(pid=9687): stdout: | (launched: 2022-12-14_04:39:36.428578) 04:39:39.731509 run osmo-hlr_10.42.42.2(pid=9687): stderr: | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043936605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043936618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043936626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043936626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043936626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:39.781298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9682): Terminating (SIGTERM) 04:39:39.821076 run iperf3-srv_10.42.42.10(pid=9683): Terminating (SIGTERM) 04:39:39.860561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9686): Terminating (SIGTERM) 04:39:39.900154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9689): Terminating (SIGTERM) 04:39:39.939675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9692): Terminating (SIGTERM) 04:39:39.980193 --- ParallelTerminationStrategy: PID 9682 died... 04:39:39.999267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9682): Terminated: ok {rc=0} 04:39:40.043050 --- ParallelTerminationStrategy: PID 9683 died... 04:39:40.061650 run iperf3-srv_10.42.42.10(pid=9683): Terminated {rc=256} 04:39:40.105415 --- ParallelTerminationStrategy: PID 9686 died... 04:39:40.124014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9686): Terminated: ok {rc=0} 04:39:40.167751 --- ParallelTerminationStrategy: PID 9689 died... 04:39:40.186469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9689): Terminated: ok {rc=0} 04:39:40.230134 --- ParallelTerminationStrategy: PID 9692 died... 04:39:40.248797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9692): Terminated: ok {rc=0} 04:39:40.333990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:39:41.487360 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:41.499927 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:39:41.546930 tst iperf3m4.py: using LAC 38607 04:39:41.674286 tst iperf3m4.py: using RAC 102 04:39:41.801179 tst iperf3m4.py: using CellId 38607 04:39:41.926010 tst iperf3m4.py: using BVCI 38608 04:39:42.044889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.056610 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.067969 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.079392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.090975 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.102513 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.114320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.125873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:39:42.137560 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:42.255482 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:42.379450 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:42.501634 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:39:42.619877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:39:42.839932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:43.168454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9694): Launched 04:39:43.454087 run iperf3-srv_10.42.42.10(pid=9695): Launched 04:39:43.578373 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:39:43.798076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:44.127032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Launched 04:39:44.412905 run iperf3-srv_10.42.42.10(pid=9697): Launched 04:39:44.535257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:39:44.754455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:45.083297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Launched 04:39:45.369925 run iperf3-srv_10.42.42.10(pid=9699): Launched 04:39:45.492202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:39:45.711376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:39:46.051609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Launched 04:39:46.339784 run iperf3-srv_10.42.42.10(pid=9701): Launched 04:39:46.469939 tst iperf3m4.py:8: start network... 04:39:46.682354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:39:47.177739 run create_hlr_db(pid=9702): Launched 04:39:47.311672 bus /gobi_6: Setting Powered False 04:39:48.376153 run create_hlr_db(pid=9702): Terminated: ok {rc=0} 04:39:48.816311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9704): Launched 04:39:49.119452 run osmo-hlr_10.42.42.2(pid=9705): Launched 04:39:49.232697 run osmo-stp_10.42.42.5: Starting osmo-stp 04:39:49.758662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9707): Launched 04:39:50.060535 run osmo-stp_10.42.42.5(pid=9708): Launched 04:39:50.174073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:39:50.693230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9710): Launched 04:39:50.807820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:39:51.065361 run patchelf(pid=9711): Launched 04:39:51.233396 run osmo-stp_10.42.42.5(pid=9708): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9708)] 04:39:51.361184 run osmo-stp_10.42.42.5(pid=9708): stdout: | (launched: 2022-12-14_04:39:50.003339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:51.490198 run osmo-stp_10.42.42.5(pid=9708): stderr: | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043950172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:51.619361 run osmo-stp_10.42.42.5(pid=9708): stdout: | (launched: 2022-12-14_04:39:50.003339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:39:51.743160 run osmo-stp_10.42.42.5(pid=9708): stderr: | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214043950172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214043950172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214043950173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:39:51.889915 run patchelf(pid=9711): Terminating (SIGINT) 04:39:52.059333 run patchelf(pid=9711): Terminated: ok {rc=0} 04:39:52.181414 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9708): Process ended prematurely: osmo-stp_10.42.42.5(pid=9708) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9708)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 04:39:52.190996 tst iperf3m4.py:8: Test FAILED (10.7 sec) 04:39:52.218442 run osmo-hlr_10.42.42.2(pid=9705): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9705)] 04:39:52.265644 run osmo-hlr_10.42.42.2(pid=9705): stdout: | (launched: 2022-12-14_04:39:49.062250) 04:39:52.314408 run osmo-hlr_10.42.42.2(pid=9705): stderr: | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214043949239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214043949252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214043949262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214043949263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214043949263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:39:52.363969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9694): Terminating (SIGTERM) 04:39:52.403619 run iperf3-srv_10.42.42.10(pid=9695): Terminating (SIGTERM) 04:39:52.442925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Terminating (SIGTERM) 04:39:52.482311 run iperf3-srv_10.42.42.10(pid=9697): Terminating (SIGTERM) 04:39:52.521414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Terminating (SIGTERM) 04:39:52.560753 run iperf3-srv_10.42.42.10(pid=9699): Terminating (SIGTERM) 04:39:52.599908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminating (SIGTERM) 04:39:52.639240 run iperf3-srv_10.42.42.10(pid=9701): Terminating (SIGTERM) 04:39:52.678500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9704): Terminating (SIGTERM) 04:39:52.718424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9707): Terminating (SIGTERM) 04:39:52.757871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9710): Terminating (SIGTERM) 04:39:52.797659 --- ParallelTerminationStrategy: PID 9694 died... 04:39:52.816697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9694): Terminated: ok {rc=0} 04:39:52.860443 --- ParallelTerminationStrategy: PID 9695 died... 04:39:52.879204 run iperf3-srv_10.42.42.10(pid=9695): Terminated {rc=256} 04:39:52.922713 --- ParallelTerminationStrategy: PID 9696 died... 04:39:52.941570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Terminated: ok {rc=0} 04:39:52.985257 --- ParallelTerminationStrategy: PID 9697 died... 04:39:53.003565 run iperf3-srv_10.42.42.10(pid=9697): Terminated {rc=256} 04:39:53.046973 --- ParallelTerminationStrategy: PID 9698 died... 04:39:53.065559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Terminated: ok {rc=0} 04:39:53.108853 --- ParallelTerminationStrategy: PID 9699 died... 04:39:53.127714 run iperf3-srv_10.42.42.10(pid=9699): Terminated {rc=256} 04:39:53.170933 --- ParallelTerminationStrategy: PID 9700 died... 04:39:53.189531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminated: ok {rc=0} 04:39:53.233076 --- ParallelTerminationStrategy: PID 9701 died... 04:39:53.251456 run iperf3-srv_10.42.42.10(pid=9701): Terminated {rc=256} 04:39:53.294727 --- ParallelTerminationStrategy: PID 9704 died... 04:39:53.313251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9704): Terminated: ok {rc=0} 04:39:53.356726 --- ParallelTerminationStrategy: PID 9707 died... 04:39:53.375303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9707): Terminated: ok {rc=0} 04:39:53.418719 --- ParallelTerminationStrategy: PID 9710 died... 04:39:53.437376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9710): Terminated: ok {rc=0} 04:39:53.522990 bus /gobi_4: Setting Powered False 04:39:54.623317 bus /gobi_4: Setting Powered False 04:39:55.738811 bus /gobi_1: Setting Powered False 04:39:56.838735 bus /gobi_1: Setting Powered False 04:39:57.952273 bus /gobi_0: Setting Powered False 04:39:59.062867 bus /gobi_0: Setting Powered False 04:40:00.173984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 04:40:01.287019 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.299137 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:40:01.349116 tst ping.py: using LAC 38608 04:40:01.477322 tst ping.py: using RAC 103 04:40:01.601794 tst ping.py: using CellId 38608 04:40:01.726533 tst ping.py: using BVCI 38609 04:40:01.879985 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.896120 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.916555 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.928534 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.939681 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.950792 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.962228 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:01.973627 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:40:02.089998 tst ping.py:19: start network... 04:40:02.286516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:02.737140 run create_hlr_db(pid=9715): Launched 04:40:02.855458 bus /gobi_6: Setting Powered False 04:40:03.914708 run create_hlr_db(pid=9715): Terminated: ok {rc=0} 04:40:04.339697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Launched 04:40:04.650850 run osmo-hlr_10.42.42.2(pid=9718): Launched 04:40:04.769186 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:05.313066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Launched 04:40:05.624611 run osmo-stp_10.42.42.5(pid=9721): Launched 04:40:05.742896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:06.280554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Launched 04:40:06.400478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:06.664710 run patchelf(pid=9724): Launched 04:40:06.838332 run osmo-stp_10.42.42.5(pid=9721): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] 04:40:06.970884 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-14_04:40:05.567009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:07.106118 run osmo-stp_10.42.42.5(pid=9721): stderr: | [0;m[38;5;43m20221214044005753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044005754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044005754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044005754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:07.240646 run osmo-stp_10.42.42.5(pid=9721): stdout: | (launched: 2022-12-14_04:40:05.567009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:07.368726 run osmo-stp_10.42.42.5(pid=9721): stderr: | [0;m[38;5;43m20221214044005753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044005754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044005754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044005754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044005755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:07.520306 run patchelf(pid=9724): Terminating (SIGINT) 04:40:07.694977 run patchelf(pid=9724): Terminated: ok {rc=0} 04:40:07.820739 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 04:40:07.830373 tst ping.py:22: Test FAILED (6.5 sec) 04:40:07.858347 run osmo-hlr_10.42.42.2(pid=9718): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9718)] 04:40:07.908533 run osmo-hlr_10.42.42.2(pid=9718): stdout: | (launched: 2022-12-14_04:40:04.593494) 04:40:07.960749 run osmo-hlr_10.42.42.2(pid=9718): stderr: | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044004783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044004795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044004803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044004804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044004804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:08.013383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminating (SIGTERM) 04:40:08.055304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminating (SIGTERM) 04:40:08.097881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Terminating (SIGTERM) 04:40:08.140226 --- ParallelTerminationStrategy: PID 9717 died... 04:40:08.160749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9717): Terminated: ok {rc=0} 04:40:08.207342 --- ParallelTerminationStrategy: PID 9720 died... 04:40:08.227411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9720): Terminated: ok {rc=0} 04:40:08.273681 --- ParallelTerminationStrategy: PID 9723 died... 04:40:08.293643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9723): Terminated: ok {rc=0} 04:40:08.381718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:40:09.469183 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:09.481230 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:40:09.529121 tst ping_idle_ping.py: using LAC 38609 04:40:09.650953 tst ping_idle_ping.py: using RAC 104 04:40:09.771743 tst ping_idle_ping.py: using CellId 38609 04:40:09.891662 tst ping_idle_ping.py: using BVCI 38610 04:40:10.006296 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.017732 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.029186 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.040288 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.051640 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.063045 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.074820 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:40:10.086356 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:40:10.203978 tst ping_idle_ping.py:24: start network... 04:40:10.412571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:10.901376 run create_hlr_db(pid=9725): Launched 04:40:11.020572 bus /gobi_6: Setting Powered False 04:40:12.082365 run create_hlr_db(pid=9725): Terminated: ok {rc=0} 04:40:12.502470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Launched 04:40:12.793671 run osmo-hlr_10.42.42.2(pid=9728): Launched 04:40:12.904329 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:13.424902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Launched 04:40:13.715453 run osmo-stp_10.42.42.5(pid=9731): Launched 04:40:13.825480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:14.326336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Launched 04:40:14.436860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:14.681933 run patchelf(pid=9734): Launched 04:40:14.843090 run osmo-stp_10.42.42.5(pid=9731): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] 04:40:14.965996 run osmo-stp_10.42.42.5(pid=9731): stdout: | (launched: 2022-12-14_04:40:13.661582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:15.090930 run osmo-stp_10.42.42.5(pid=9731): stderr: | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044013828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:15.216464 run osmo-stp_10.42.42.5(pid=9731): stdout: | (launched: 2022-12-14_04:40:13.661582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:15.335334 run osmo-stp_10.42.42.5(pid=9731): stderr: | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044013827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044013828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044013828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:15.476316 run patchelf(pid=9734): Terminating (SIGINT) 04:40:15.638596 run patchelf(pid=9734): Terminated: ok {rc=0} 04:40:15.755425 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9731): Process ended prematurely: osmo-stp_10.42.42.5(pid=9731) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:40:15.764232 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:40:15.790556 run osmo-hlr_10.42.42.2(pid=9728): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9728)] 04:40:15.837955 run osmo-hlr_10.42.42.2(pid=9728): stdout: | (launched: 2022-12-14_04:40:12.739043) 04:40:15.893387 run osmo-hlr_10.42.42.2(pid=9728): stderr: | [0;m[1;31m20221214044012909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044012910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044012910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044012910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044012910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044012910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044012922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044012931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044012931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044012931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:15.943418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Terminating (SIGTERM) 04:40:15.984121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Terminating (SIGTERM) 04:40:16.026349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Terminating (SIGTERM) 04:40:16.068714 --- ParallelTerminationStrategy: PID 9727 died... 04:40:16.087916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9727): Terminated: ok {rc=0} 04:40:16.132220 --- ParallelTerminationStrategy: PID 9730 died... 04:40:16.151665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9730): Terminated: ok {rc=0} 04:40:16.196254 --- ParallelTerminationStrategy: PID 9733 died... 04:40:16.215322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9733): Terminated: ok {rc=0} 04:40:16.300102 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:40:17.587915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:40:17.596908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:40:17.621287 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:40:17.661522 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:40:17.750956 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:40:17.774490 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:40:17.812166 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:40:18.407251 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:40:18.454565 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:18.465518 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:18.524393 tst cs_paging_gprs_active.py: using LAC 38610 04:40:18.650999 tst cs_paging_gprs_active.py: using RAC 105 04:40:18.776841 tst cs_paging_gprs_active.py: using CellId 38610 04:40:18.901833 tst cs_paging_gprs_active.py: using BVCI 38611 04:40:19.019571 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.031384 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.042864 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.054012 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.065916 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.077908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.090010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.101848 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:19.114138 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:19.237180 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:19.352899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:40:19.550228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:19.846313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Launched 04:40:20.103117 run iperf3-srv_10.42.42.10(pid=9739): Launched 04:40:20.213410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:40:20.409530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:20.705860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Launched 04:40:20.963555 run iperf3-srv_10.42.42.10(pid=9741): Launched 04:40:21.074209 tst cs_paging_gprs_active.py:38: start network... 04:40:21.272064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:21.731376 run create_hlr_db(pid=9742): Launched 04:40:21.853138 bus /gobi_6: Setting Powered False 04:40:22.912876 run create_hlr_db(pid=9742): Terminated: ok {rc=0} 04:40:23.346641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9744): Launched 04:40:23.666290 run osmo-hlr_10.42.42.2(pid=9745): Launched 04:40:23.786499 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:24.336079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9747): Launched 04:40:24.653926 run osmo-stp_10.42.42.5(pid=9748): Launched 04:40:24.774424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:25.323539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9750): Launched 04:40:25.446092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:25.714902 run patchelf(pid=9751): Launched 04:40:25.891309 run osmo-stp_10.42.42.5(pid=9748): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9748)] 04:40:26.026308 run osmo-stp_10.42.42.5(pid=9748): stdout: | (launched: 2022-12-14_04:40:24.595629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:26.162902 run osmo-stp_10.42.42.5(pid=9748): stderr: | [0;m[38;5;43m20221214044024782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044024782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044024783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044024783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044024783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044024783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044024784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:26.299345 run osmo-stp_10.42.42.5(pid=9748): stdout: | (launched: 2022-12-14_04:40:24.595629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:26.429885 run osmo-stp_10.42.42.5(pid=9748): stderr: | [0;m[38;5;43m20221214044024782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044024782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044024783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044024783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044024783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044024783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044024784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:26.584683 run patchelf(pid=9751): Terminating (SIGINT) 04:40:26.762655 run patchelf(pid=9751): Terminated: ok {rc=0} 04:40:26.890942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9748): Process ended prematurely: osmo-stp_10.42.42.5(pid=9748) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9748)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:40:26.901074 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 04:40:26.929572 run osmo-hlr_10.42.42.2(pid=9745): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9745)] 04:40:26.980361 run osmo-hlr_10.42.42.2(pid=9745): stdout: | (launched: 2022-12-14_04:40:23.607732) 04:40:27.033397 run osmo-hlr_10.42.42.2(pid=9745): stderr: | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044023800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044023813 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044023822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044023822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044023822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:27.085974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Terminating (SIGTERM) 04:40:27.127619 run iperf3-srv_10.42.42.10(pid=9739): Terminating (SIGTERM) 04:40:27.170245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Terminating (SIGTERM) 04:40:27.212363 run iperf3-srv_10.42.42.10(pid=9741): Terminating (SIGTERM) 04:40:27.254515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9744): Terminating (SIGTERM) 04:40:27.296426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9747): Terminating (SIGTERM) 04:40:27.338386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9750): Terminating (SIGTERM) 04:40:27.380841 --- ParallelTerminationStrategy: PID 9738 died... 04:40:27.401507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Terminated: ok {rc=0} 04:40:27.448267 --- ParallelTerminationStrategy: PID 9739 died... 04:40:27.468204 run iperf3-srv_10.42.42.10(pid=9739): Terminated {rc=256} 04:40:27.514438 --- ParallelTerminationStrategy: PID 9740 died... 04:40:27.534381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Terminated: ok {rc=0} 04:40:27.580590 --- ParallelTerminationStrategy: PID 9741 died... 04:40:27.600564 run iperf3-srv_10.42.42.10(pid=9741): Terminated {rc=256} 04:40:27.646561 --- ParallelTerminationStrategy: PID 9744 died... 04:40:27.666331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9744): Terminated: ok {rc=0} 04:40:27.712352 --- ParallelTerminationStrategy: PID 9747 died... 04:40:27.732372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9747): Terminated: ok {rc=0} 04:40:27.778348 --- ParallelTerminationStrategy: PID 9750 died... 04:40:27.798185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9750): Terminated: ok {rc=0} 04:40:27.885946 bus /gobi_0: Setting Powered False 04:40:28.984093 bus /gobi_0: Setting Powered False 04:40:30.097922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:40:31.240460 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.252715 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:31.314788 tst iperf3.py: using LAC 38611 04:40:31.433666 tst iperf3.py: using RAC 106 04:40:31.586270 tst iperf3.py: using CellId 38611 04:40:31.704197 tst iperf3.py: using BVCI 38612 04:40:31.824353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.837159 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.849798 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.862495 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.876019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.889977 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.904228 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.921192 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:31.937607 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:32.091436 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:40:32.292135 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:32.588482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9752): Launched 04:40:32.848314 run iperf3-srv_10.42.42.10(pid=9753): Launched 04:40:32.960151 tst iperf3.py:8: start network... 04:40:33.158999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:33.622167 run create_hlr_db(pid=9754): Launched 04:40:33.743950 bus /gobi_6: Setting Powered False 04:40:34.803044 run create_hlr_db(pid=9754): Terminated: ok {rc=0} 04:40:35.218229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Launched 04:40:35.515486 run osmo-hlr_10.42.42.2(pid=9757): Launched 04:40:35.627645 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:36.156852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Launched 04:40:36.454879 run osmo-stp_10.42.42.5(pid=9760): Launched 04:40:36.568088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:37.086486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Launched 04:40:37.200052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:37.452814 run patchelf(pid=9763): Launched 04:40:37.618934 run osmo-stp_10.42.42.5(pid=9760): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] 04:40:37.744634 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-14_04:40:36.399424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:37.872252 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221214044036566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044036566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044036567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044036567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044036567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044036568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044036568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:38.000229 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-14_04:40:36.399424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:38.122518 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221214044036566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044036566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044036567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044036567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044036567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044036568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044036568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:38.267002 run patchelf(pid=9763): Terminating (SIGINT) 04:40:38.433889 run patchelf(pid=9763): Terminated: ok {rc=0} 04:40:38.554160 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:40:38.563517 tst iperf3.py:8: Test FAILED (7.4 sec) 04:40:38.590607 run osmo-hlr_10.42.42.2(pid=9757): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9757)] 04:40:38.637724 run osmo-hlr_10.42.42.2(pid=9757): stdout: | (launched: 2022-12-14_04:40:35.460610) 04:40:38.686646 run osmo-hlr_10.42.42.2(pid=9757): stderr: | [0;m[1;31m20221214044035634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044035634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044035634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044035634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044035635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044035635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044035647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044035656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044035656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044035656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:38.735975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9752): Terminating (SIGTERM) 04:40:38.775279 run iperf3-srv_10.42.42.10(pid=9753): Terminating (SIGTERM) 04:40:38.814470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminating (SIGTERM) 04:40:38.853747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminating (SIGTERM) 04:40:38.892836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminating (SIGTERM) 04:40:38.932261 --- ParallelTerminationStrategy: PID 9752 died... 04:40:38.951202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9752): Terminated: ok {rc=0} 04:40:38.994681 --- ParallelTerminationStrategy: PID 9753 died... 04:40:39.012939 run iperf3-srv_10.42.42.10(pid=9753): Terminated {rc=256} 04:40:39.056499 --- ParallelTerminationStrategy: PID 9756 died... 04:40:39.075025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminated: ok {rc=0} 04:40:39.118451 --- ParallelTerminationStrategy: PID 9759 died... 04:40:39.137079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminated: ok {rc=0} 04:40:39.180349 --- ParallelTerminationStrategy: PID 9762 died... 04:40:39.198764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminated: ok {rc=0} 04:40:39.283437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:40:40.429267 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:40.440778 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:40.501511 tst iperf3m4.py: using LAC 38612 04:40:40.619502 tst iperf3m4.py: using RAC 107 04:40:40.737573 tst iperf3m4.py: using CellId 38612 04:40:40.854307 tst iperf3m4.py: using BVCI 38613 04:40:40.963289 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:40.974361 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:40.985334 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:40.996070 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:41.006775 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:41.017586 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:41.028375 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:41.039208 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:41.050149 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:41.165679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:41.286906 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:41.403330 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:40:41.524461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:40:41.723277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:42.022773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9764): Launched 04:40:42.283648 run iperf3-srv_10.42.42.10(pid=9765): Launched 04:40:42.395604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:40:42.594341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:42.893789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Launched 04:40:43.153481 run iperf3-srv_10.42.42.10(pid=9767): Launched 04:40:43.265833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:40:43.465693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:43.766145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Launched 04:40:44.025425 run iperf3-srv_10.42.42.10(pid=9769): Launched 04:40:44.137768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:40:44.335839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:40:44.635877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Launched 04:40:44.894917 run iperf3-srv_10.42.42.10(pid=9771): Launched 04:40:45.006364 tst iperf3m4.py:8: start network... 04:40:45.204398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:40:45.667583 run create_hlr_db(pid=9772): Launched 04:40:45.789899 bus /gobi_6: Setting Powered False 04:40:46.849156 run create_hlr_db(pid=9772): Terminated: ok {rc=0} 04:40:47.300630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9774): Launched 04:40:47.606205 run osmo-hlr_10.42.42.2(pid=9775): Launched 04:40:47.719919 run osmo-stp_10.42.42.5: Starting osmo-stp 04:40:48.235753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9777): Launched 04:40:48.534446 run osmo-stp_10.42.42.5(pid=9778): Launched 04:40:48.647730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:40:49.166276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9780): Launched 04:40:49.280362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:40:49.534605 run patchelf(pid=9781): Launched 04:40:49.702418 run osmo-stp_10.42.42.5(pid=9778): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9778)] 04:40:49.830158 run osmo-stp_10.42.42.5(pid=9778): stdout: | (launched: 2022-12-14_04:40:48.478728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:49.959457 run osmo-stp_10.42.42.5(pid=9778): stderr: | [0;m[38;5;43m20221214044048646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044048646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044048647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044048647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044048647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:50.088617 run osmo-stp_10.42.42.5(pid=9778): stdout: | (launched: 2022-12-14_04:40:48.478728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:40:50.212417 run osmo-stp_10.42.42.5(pid=9778): stderr: | [0;m[38;5;43m20221214044048646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044048646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044048647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044048647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044048647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044048648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:40:50.359248 run patchelf(pid=9781): Terminating (SIGINT) 04:40:50.528248 run patchelf(pid=9781): Terminated: ok {rc=0} 04:40:50.650462 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9778): Process ended prematurely: osmo-stp_10.42.42.5(pid=9778) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9778)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:40:50.659875 tst iperf3m4.py:8: Test FAILED (10.3 sec) 04:40:50.687221 run osmo-hlr_10.42.42.2(pid=9775): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9775)] 04:40:50.734341 run osmo-hlr_10.42.42.2(pid=9775): stdout: | (launched: 2022-12-14_04:40:47.549764) 04:40:50.783018 run osmo-hlr_10.42.42.2(pid=9775): stderr: | [0;m[1;31m20221214044047722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044047722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044047723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044047723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044047723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044047723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044047735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044047743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044047743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044047744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:40:50.832107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9764): Terminating (SIGTERM) 04:40:50.871154 run iperf3-srv_10.42.42.10(pid=9765): Terminating (SIGTERM) 04:40:50.910120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Terminating (SIGTERM) 04:40:50.949105 run iperf3-srv_10.42.42.10(pid=9767): Terminating (SIGTERM) 04:40:50.987861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Terminating (SIGTERM) 04:40:51.026811 run iperf3-srv_10.42.42.10(pid=9769): Terminating (SIGTERM) 04:40:51.065685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Terminating (SIGTERM) 04:40:51.104498 run iperf3-srv_10.42.42.10(pid=9771): Terminating (SIGTERM) 04:40:51.143297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9774): Terminating (SIGTERM) 04:40:51.182278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9777): Terminating (SIGTERM) 04:40:51.221064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9780): Terminating (SIGTERM) 04:40:51.260216 --- ParallelTerminationStrategy: PID 9764 died... 04:40:51.279181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9764): Terminated: ok {rc=0} 04:40:51.322562 --- ParallelTerminationStrategy: PID 9765 died... 04:40:51.340888 run iperf3-srv_10.42.42.10(pid=9765): Terminated {rc=256} 04:40:51.384024 --- ParallelTerminationStrategy: PID 9766 died... 04:40:51.402767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9766): Terminated: ok {rc=0} 04:40:51.446244 --- ParallelTerminationStrategy: PID 9767 died... 04:40:51.464658 run iperf3-srv_10.42.42.10(pid=9767): Terminated {rc=256} 04:40:51.508031 --- ParallelTerminationStrategy: PID 9768 died... 04:40:51.526601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9768): Terminated: ok {rc=0} 04:40:51.569972 --- ParallelTerminationStrategy: PID 9769 died... 04:40:51.588463 run iperf3-srv_10.42.42.10(pid=9769): Terminated {rc=256} 04:40:51.631886 --- ParallelTerminationStrategy: PID 9770 died... 04:40:51.650447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9770): Terminated: ok {rc=0} 04:40:51.693699 --- ParallelTerminationStrategy: PID 9771 died... 04:40:51.712128 run iperf3-srv_10.42.42.10(pid=9771): Terminated {rc=256} 04:40:51.755417 --- ParallelTerminationStrategy: PID 9774 died... 04:40:51.773930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9774): Terminated: ok {rc=0} 04:40:51.817263 --- ParallelTerminationStrategy: PID 9777 died... 04:40:51.835701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9777): Terminated: ok {rc=0} 04:40:51.879079 --- ParallelTerminationStrategy: PID 9780 died... 04:40:51.897890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9780): Terminated: ok {rc=0} 04:40:51.984397 bus /gobi_4: Setting Powered False 04:40:53.087534 bus /gobi_4: Setting Powered False 04:40:54.205050 bus /gobi_1: Setting Powered False 04:40:55.300364 bus /gobi_1: Setting Powered False 04:40:56.415274 bus /gobi_0: Setting Powered False 04:40:57.513522 bus /gobi_0: Setting Powered False 04:40:58.628447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:40:59.731214 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:40:59.742848 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:40:59.802199 tst ping.py: using LAC 38613 04:40:59.919304 tst ping.py: using RAC 108 04:41:00.037377 tst ping.py: using CellId 38613 04:41:00.154164 tst ping.py: using BVCI 38614 04:41:00.264143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.275408 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.286351 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.297218 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.307953 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.318848 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.329827 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:00.340586 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:41:00.455815 tst ping.py:19: start network... 04:41:00.654406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:01.149137 run create_hlr_db(pid=9785): Launched 04:41:01.307883 bus /gobi_6: Setting Powered False 04:41:02.371172 run create_hlr_db(pid=9785): Terminated: ok {rc=0} 04:41:02.800304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Launched 04:41:03.099133 run osmo-hlr_10.42.42.2(pid=9788): Launched 04:41:03.213549 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:03.732902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Launched 04:41:04.029640 run osmo-stp_10.42.42.5(pid=9791): Launched 04:41:04.142691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:04.659193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Launched 04:41:04.772145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:05.023208 run patchelf(pid=9794): Launched 04:41:05.187975 run osmo-stp_10.42.42.5(pid=9791): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] 04:41:05.313412 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-14_04:41:03.974445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:05.440787 run osmo-stp_10.42.42.5(pid=9791): stderr: | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044104144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:05.568792 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-14_04:41:03.974445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:05.690073 run osmo-stp_10.42.42.5(pid=9791): stderr: | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044104143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044104144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044104144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:05.833535 run patchelf(pid=9794): Terminating (SIGINT) 04:41:05.999512 run patchelf(pid=9794): Terminated: ok {rc=0} 04:41:06.119144 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 04:41:06.128046 tst ping.py:22: Test FAILED (6.4 sec) 04:41:06.154467 run osmo-hlr_10.42.42.2(pid=9788): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9788)] 04:41:06.201443 run osmo-hlr_10.42.42.2(pid=9788): stdout: | (launched: 2022-12-14_04:41:03.043320) 04:41:06.250933 run osmo-hlr_10.42.42.2(pid=9788): stderr: | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044103218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044103230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044103240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044103240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044103240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:06.299952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminating (SIGTERM) 04:41:06.339097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminating (SIGTERM) 04:41:06.378595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminating (SIGTERM) 04:41:06.418094 --- ParallelTerminationStrategy: PID 9787 died... 04:41:06.437137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminated: ok {rc=0} 04:41:06.480691 --- ParallelTerminationStrategy: PID 9790 died... 04:41:06.499303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminated: ok {rc=0} 04:41:06.542514 --- ParallelTerminationStrategy: PID 9793 died... 04:41:06.560866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminated: ok {rc=0} 04:41:06.646315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:41:07.733558 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:07.745209 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:41:07.807351 tst ping_idle_ping.py: using LAC 38614 04:41:07.925034 tst ping_idle_ping.py: using RAC 109 04:41:08.044028 tst ping_idle_ping.py: using CellId 38614 04:41:08.160561 tst ping_idle_ping.py: using BVCI 38615 04:41:08.267991 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.278989 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.289735 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.300517 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.311681 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.322952 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.334344 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:41:08.345661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:41:08.461125 tst ping_idle_ping.py:24: start network... 04:41:08.659562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:09.124940 run create_hlr_db(pid=9795): Launched 04:41:09.245986 bus /gobi_6: Setting Powered False 04:41:10.305935 run create_hlr_db(pid=9795): Terminated: ok {rc=0} 04:41:10.722631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9797): Launched 04:41:11.019826 run osmo-hlr_10.42.42.2(pid=9798): Launched 04:41:11.132621 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:11.653527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9800): Launched 04:41:11.953338 run osmo-stp_10.42.42.5(pid=9801): Launched 04:41:12.066823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:12.583258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9803): Launched 04:41:12.696362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:12.947881 run patchelf(pid=9804): Launched 04:41:13.112837 run osmo-stp_10.42.42.5(pid=9801): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9801)] 04:41:13.237777 run osmo-stp_10.42.42.5(pid=9801): stdout: | (launched: 2022-12-14_04:41:11.897222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:13.364742 run osmo-stp_10.42.42.5(pid=9801): stderr: | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044112067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:13.491743 run osmo-stp_10.42.42.5(pid=9801): stdout: | (launched: 2022-12-14_04:41:11.897222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:13.613343 run osmo-stp_10.42.42.5(pid=9801): stderr: | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044112066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044112067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044112067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:13.756689 run patchelf(pid=9804): Terminating (SIGINT) 04:41:13.922681 run patchelf(pid=9804): Terminated: ok {rc=0} 04:41:14.041894 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9801): Process ended prematurely: osmo-stp_10.42.42.5(pid=9801) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9801)] [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:41:14.050767 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 04:41:14.077652 run osmo-hlr_10.42.42.2(pid=9798): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9798)] 04:41:14.124620 run osmo-hlr_10.42.42.2(pid=9798): stdout: | (launched: 2022-12-14_04:41:10.964135) 04:41:14.173296 run osmo-hlr_10.42.42.2(pid=9798): stderr: | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044111138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044111150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044111159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044111159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044111159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:14.222591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9797): Terminating (SIGTERM) 04:41:14.261798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9800): Terminating (SIGTERM) 04:41:14.301035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9803): Terminating (SIGTERM) 04:41:14.340204 --- ParallelTerminationStrategy: PID 9797 died... 04:41:14.359091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9797): Terminated: ok {rc=0} 04:41:14.402353 --- ParallelTerminationStrategy: PID 9800 died... 04:41:14.420591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9800): Terminated: ok {rc=0} 04:41:14.463936 --- ParallelTerminationStrategy: PID 9803 died... 04:41:14.482404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9803): Terminated: ok {rc=0} 04:41:14.567321 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:41:15.873285 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:15.886580 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:41:15.914223 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:41:15.954362 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:41:16.014683 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:41:16.044276 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:41:16.082369 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:41:16.647619 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:41:16.655176 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:16.672594 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:41:16.743924 tst switch_tch_pdch.py: using LAC 38615 04:41:16.905840 tst switch_tch_pdch.py: using RAC 110 04:41:17.066392 tst switch_tch_pdch.py: using CellId 38615 04:41:17.192158 tst switch_tch_pdch.py: using BVCI 38616 04:41:17.313642 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.325822 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.337752 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.349564 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.361357 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.372519 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.384089 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:41:17.395625 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:41:17.515831 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:41:17.636495 tst switch_tch_pdch.py:51: start network... 04:41:17.849924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:18.343963 run create_hlr_db(pid=9808): Launched 04:41:18.466991 bus /gobi_6: Setting Powered False 04:41:19.530313 run create_hlr_db(pid=9808): Terminated: ok {rc=0} 04:41:19.957201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9810): Launched 04:41:20.254255 run osmo-hlr_10.42.42.2(pid=9811): Launched 04:41:20.366618 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:20.879666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9813): Launched 04:41:21.176236 run osmo-stp_10.42.42.5(pid=9814): Launched 04:41:21.288432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:41:21.803077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9816): Launched 04:41:21.916357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:41:22.167768 run patchelf(pid=9817): Launched 04:41:22.332536 run osmo-stp_10.42.42.5(pid=9814): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9814)] 04:41:22.458434 run osmo-stp_10.42.42.5(pid=9814): stdout: | (launched: 2022-12-14_04:41:21.120687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:22.585633 run osmo-stp_10.42.42.5(pid=9814): stderr: | [0;m[38;5;43m20221214044121291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044121292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044121292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044121292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:22.713653 run osmo-stp_10.42.42.5(pid=9814): stdout: | (launched: 2022-12-14_04:41:21.120687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:22.835066 run osmo-stp_10.42.42.5(pid=9814): stderr: | [0;m[38;5;43m20221214044121291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044121292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044121292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044121292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044121293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:22.979143 run patchelf(pid=9817): Terminating (SIGINT) 04:41:23.146125 run patchelf(pid=9817): Terminated: ok {rc=0} 04:41:23.265944 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9814): Process ended prematurely: osmo-stp_10.42.42.5(pid=9814) [trial-2399↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9814)] [trial-2399↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:41:23.274928 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 04:41:23.301535 run osmo-hlr_10.42.42.2(pid=9811): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9811)] 04:41:23.348691 run osmo-hlr_10.42.42.2(pid=9811): stdout: | (launched: 2022-12-14_04:41:20.198958) 04:41:23.397537 run osmo-hlr_10.42.42.2(pid=9811): stderr: | [0;m[1;31m20221214044120371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044120371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044120372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044120372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044120372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044120372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044120423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044120433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044120434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044120434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:23.446839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9810): Terminating (SIGTERM) 04:41:23.485928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9813): Terminating (SIGTERM) 04:41:23.525111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9816): Terminating (SIGTERM) 04:41:23.564408 --- ParallelTerminationStrategy: PID 9810 died... 04:41:23.583277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9810): Terminated: ok {rc=0} 04:41:23.626546 --- ParallelTerminationStrategy: PID 9813 died... 04:41:23.644816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9813): Terminated: ok {rc=0} 04:41:23.688637 --- ParallelTerminationStrategy: PID 9816 died... 04:41:23.707124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9816): Terminated: ok {rc=0} 04:41:23.789481 bus /gobi_0: Setting Powered False 04:41:24.887055 bus /gobi_0: Setting Powered False 04:41:26.002282 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 sms:nanobts+band-900 --------------------------------------------------------------------- 04:41:27.243261 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:27.248007 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:27.279857 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:41:27.306264 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 04:41:27.357741 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:27.389711 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:41:27.416317 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 04:41:27.966391 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 04:41:27.972308 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:27.983872 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:28.043275 tst mo_mt_sms.py: using LAC 38616 04:41:28.161997 tst mo_mt_sms.py: using RAC 111 04:41:28.281226 tst mo_mt_sms.py: using CellId 38616 04:41:28.397440 tst mo_mt_sms.py: using BVCI 38617 04:41:28.504250 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:28.514854 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:28.525324 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:28.535618 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:28.546056 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:28.556427 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:41:28.670714 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 04:41:28.789754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:29.285959 run create_hlr_db(pid=9821): Launched 04:41:29.409062 bus /gobi_6: Setting Powered False 04:41:30.471708 run create_hlr_db(pid=9821): Terminated: ok {rc=0} 04:41:30.908941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9823): Launched 04:41:31.244714 run osmo-hlr_10.42.42.2(pid=9824): Launched 04:41:31.472160 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:32.138202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9826): Launched 04:41:32.469843 run osmo-stp_10.42.42.5(pid=9827): Launched 04:41:32.593163 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:33.170894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9829): Launched 04:41:33.491567 run osmo-msc_10.42.42.6(pid=9830): Launched 04:41:33.669496 run osmo-stp_10.42.42.5(pid=9827): ERR: Terminated: ERROR {rc=1} [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9827)] 04:41:33.804342 run osmo-stp_10.42.42.5(pid=9827): stdout: | (launched: 2022-12-14_04:41:32.410835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:33.939946 run osmo-stp_10.42.42.5(pid=9827): stderr: | [0;m[38;5;43m20221214044132600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044132600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044132601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044132601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:34.075354 run osmo-stp_10.42.42.5(pid=9827): stdout: | (launched: 2022-12-14_04:41:32.410835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:34.202897 run osmo-stp_10.42.42.5(pid=9827): stderr: | [0;m[38;5;43m20221214044132600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044132600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044132601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044132601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044132602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:34.354993 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9827): Process ended prematurely: osmo-stp_10.42.42.5(pid=9827) [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9827)] [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py:16] 04:41:34.363970 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 04:41:34.391346 run osmo-hlr_10.42.42.2(pid=9824): ERR: Terminated: ERROR {rc=237} [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9824)] 04:41:34.442047 run osmo-hlr_10.42.42.2(pid=9824): stdout: | (launched: 2022-12-14_04:41:31.184881) 04:41:34.493863 run osmo-hlr_10.42.42.2(pid=9824): stderr: | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044131495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044131512 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044131520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044131520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044131520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:34.566109 run osmo-msc_10.42.42.6(pid=9830): ERR: Terminated: ERROR {rc=2} [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9830)] 04:41:34.615803 run osmo-msc_10.42.42.6(pid=9830): stdout: | (launched: 2022-12-14_04:41:33.432629) 04:41:34.667362 run osmo-msc_10.42.42.6(pid=9830): stderr: | [0;m[38;5;43m20221214044133752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044133752 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd26ed48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044133752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044133752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044133752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044133753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044133754 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044133755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044133755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044133755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:34.719654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9823): Terminating (SIGTERM) 04:41:34.761594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9826): Terminating (SIGTERM) 04:41:34.804081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9829): Terminating (SIGTERM) 04:41:34.846385 --- ParallelTerminationStrategy: PID 9823 died... 04:41:34.866877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9823): Terminated: ok {rc=0} 04:41:34.913346 --- ParallelTerminationStrategy: PID 9826 died... 04:41:34.933415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9826): Terminated: ok {rc=0} 04:41:34.979607 --- ParallelTerminationStrategy: PID 9829 died... 04:41:34.999446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9829): Terminated: ok {rc=0} 04:41:35.088558 bus /sierra_3: Setting Powered False 04:41:36.187119 bus /sierra_3: Setting Powered False 04:41:37.303415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 04:41:38.538333 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:38.543619 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:38.576607 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 04:41:38.585098 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:41:38.621864 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:38.654242 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 04:41:38.660895 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:41:39.179567 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:41:39.184531 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 04:41:39.195348 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:39.242586 tst assert_extension.py: using LAC 38617 04:41:39.368796 tst assert_extension.py: using RAC 112 04:41:39.497431 tst assert_extension.py: using CellId 38617 04:41:39.627709 tst assert_extension.py: using BVCI 38618 04:41:39.745197 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:41:39.860140 tst assert_extension.py:10: start nitb and bts... 04:41:40.077340 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:41:40.728531 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9835): Launched 04:41:41.048735 run osmo-nitb_10.42.42.2(pid=9836): Launched 04:41:41.226879 run osmo-nitb_10.42.42.2(pid=9836): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9836)] 04:41:41.370389 run osmo-nitb_10.42.42.2(pid=9836): stdout: | (launched: 2022-12-14_04:41:40.990002) 04:41:41.515213 run osmo-nitb_10.42.42.2(pid=9836): stderr: | (launched: 2022-12-14_04:41:41.037475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:41:41.660198 run osmo-nitb_10.42.42.2(pid=9836): stdout: | (launched: 2022-12-14_04:41:40.990002) 04:41:41.798886 run osmo-nitb_10.42.42.2(pid=9836): stderr: | (launched: 2022-12-14_04:41:41.037475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9836): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9836) [trial-2399↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9836)] 04:41:42.170468 tst osmo-nitb_10.42.42.2(pid=9836): stdout: | (launched: 2022-12-14_04:41:40.990002) 04:41:42.300053 tst osmo-nitb_10.42.42.2(pid=9836): stderr: | (launched: 2022-12-14_04:41:41.037475) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:41:42.452590 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9836): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9836) [trial-2399↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9836)] [trial-2399↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 04:41:42.461971 tst assert_extension.py:12: Test FAILED (3.3 sec) 04:41:42.469267 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9835): Terminating (SIGTERM) 04:41:42.680164 --- ParallelTerminationStrategy: PID 9835 died... 04:41:42.701701 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9835): Terminated: ok {rc=0} 04:41:42.790927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 ussd:nanobts+band-900 --------------------------------------------------------------------- 04:41:43.968573 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:43.975027 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:41:44.007802 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:41:44.034914 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 04:41:44.070407 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:41:44.102100 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:41:44.128152 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 04:41:44.657869 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 04:41:44.663176 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:44.673961 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 04:41:44.723526 tst assert_extension.py: using LAC 38618 04:41:44.849082 tst assert_extension.py: using RAC 113 04:41:44.972325 tst assert_extension.py: using CellId 38618 04:41:45.096093 tst assert_extension.py: using BVCI 38619 04:41:45.213863 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:45.225155 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:45.236329 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:45.247464 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:45.259050 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:41:45.270605 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 04:41:45.385886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:45.867573 run create_hlr_db(pid=9840): Launched 04:41:46.027046 bus /sierra_2: Setting Powered False 04:41:47.092434 run create_hlr_db(pid=9840): Terminated: ok {rc=0} 04:41:47.571737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9842): Launched 04:41:47.893585 run osmo-hlr_10.42.42.2(pid=9843): Launched 04:41:48.016888 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:48.572786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9845): Launched 04:41:48.892118 run osmo-stp_10.42.42.5(pid=9846): Launched 04:41:49.014952 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:49.592480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9848): Launched 04:41:49.912529 run osmo-msc_10.42.42.6(pid=9849): Launched 04:41:50.090844 run osmo-stp_10.42.42.5(pid=9846): ERR: Terminated: ERROR {rc=1} [trial-2399↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9846)] 04:41:50.225666 run osmo-stp_10.42.42.5(pid=9846): stdout: | (launched: 2022-12-14_04:41:48.833028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:50.361207 run osmo-stp_10.42.42.5(pid=9846): stderr: | [0;m[38;5;43m20221214044149023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044149023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044149024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044149024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044149024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044149025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044149025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:50.495393 run osmo-stp_10.42.42.5(pid=9846): stdout: | (launched: 2022-12-14_04:41:48.833028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:50.622608 run osmo-stp_10.42.42.5(pid=9846): stderr: | [0;m[38;5;43m20221214044149023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044149023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044149024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044149024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044149024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044149025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044149025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:50.774447 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9846): Process ended prematurely: osmo-stp_10.42.42.5(pid=9846) [trial-2399↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9846)] [trial-2399↪ussd:nanobts+band-900↪assert_extension.py:17] 04:41:50.783622 tst assert_extension.py:17: Test FAILED (6.1 sec) 04:41:50.811191 run osmo-hlr_10.42.42.2(pid=9843): ERR: Terminated: ERROR {rc=237} [trial-2399↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9843)] 04:41:50.861994 run osmo-hlr_10.42.42.2(pid=9843): stdout: | (launched: 2022-12-14_04:41:47.834445) 04:41:50.913881 run osmo-hlr_10.42.42.2(pid=9843): stderr: | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044148032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044148044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044148052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044148052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044148052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:50.986394 run osmo-msc_10.42.42.6(pid=9849): ERR: Terminated: ERROR {rc=2} [trial-2399↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9849)] 04:41:51.036284 run osmo-msc_10.42.42.6(pid=9849): stdout: | (launched: 2022-12-14_04:41:49.852778) 04:41:51.088515 run osmo-msc_10.42.42.6(pid=9849): stderr: | [0;m[38;5;43m20221214044150172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044150172 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0bd3662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044150172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044150172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044150173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044150173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044150174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044150175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044150175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044150175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:41:51.141566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9842): Terminating (SIGTERM) 04:41:51.183162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9845): Terminating (SIGTERM) 04:41:51.225720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9848): Terminating (SIGTERM) 04:41:51.267990 --- ParallelTerminationStrategy: PID 9842 died... 04:41:51.288580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9842): Terminated: ok {rc=0} 04:41:51.335063 --- ParallelTerminationStrategy: PID 9845 died... 04:41:51.355011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9845): Terminated: ok {rc=0} 04:41:51.401412 --- ParallelTerminationStrategy: PID 9848 died... 04:41:51.421451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9848): Terminated: ok {rc=0} 04:41:51.509685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 04:41:52.722822 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:41:52.732251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 04:41:52.768248 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 04:41:52.795883 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 04:41:52.850639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 04:41:52.884905 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 04:41:52.912866 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 04:41:53.463064 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 04:41:53.517377 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:53.529312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:41:53.602999 tst mo_mt_call.py: using LAC 38619 04:41:53.731505 tst mo_mt_call.py: using RAC 114 04:41:53.857412 tst mo_mt_call.py: using CellId 38619 04:41:53.982945 tst mo_mt_call.py: using BVCI 38620 04:41:54.103240 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:54.115219 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:54.126958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:54.138392 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:54.150803 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:41:54.163306 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:54.283268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:41:54.402387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:41:54.874230 run create_hlr_db(pid=9854): Launched 04:41:55.000369 bus /sierra_2: Setting Powered False 04:41:56.061535 run create_hlr_db(pid=9854): Terminated: ok {rc=0} 04:41:56.503477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Launched 04:41:56.830592 run osmo-hlr_10.42.42.2(pid=9857): Launched 04:41:56.955144 run osmo-stp_10.42.42.5: Starting osmo-stp 04:41:57.516397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Launched 04:41:57.841057 run osmo-stp_10.42.42.5(pid=9860): Launched 04:41:57.966607 run osmo-msc_10.42.42.6: Starting osmo-msc 04:41:58.554237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9862): Launched 04:41:58.881058 run osmo-msc_10.42.42.6(pid=9863): Launched 04:41:59.063315 run osmo-stp_10.42.42.5(pid=9860): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] 04:41:59.201440 run osmo-stp_10.42.42.5(pid=9860): stdout: | (launched: 2022-12-14_04:41:57.781070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:59.339191 run osmo-stp_10.42.42.5(pid=9860): stderr: | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044157973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:59.475938 run osmo-stp_10.42.42.5(pid=9860): stdout: | (launched: 2022-12-14_04:41:57.781070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:41:59.605147 run osmo-stp_10.42.42.5(pid=9860): stderr: | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044157972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044157973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044157973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:41:59.760097 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9860): Process ended prematurely: osmo-stp_10.42.42.5(pid=9860) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 04:41:59.769939 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:41:59.798058 run osmo-hlr_10.42.42.2(pid=9857): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9857)] 04:41:59.849014 run osmo-hlr_10.42.42.2(pid=9857): stdout: | (launched: 2022-12-14_04:41:56.770353) 04:41:59.901230 run osmo-hlr_10.42.42.2(pid=9857): stderr: | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044156965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044156978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044156986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044156987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044156987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:41:59.973899 run osmo-msc_10.42.42.6(pid=9863): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9863)] 04:42:00.023795 run osmo-msc_10.42.42.6(pid=9863): stdout: | (launched: 2022-12-14_04:41:58.820878) 04:42:00.076062 run osmo-msc_10.42.42.6(pid=9863): stderr: | [0;m[38;5;43m20221214044159140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044159140 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9fb7deec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044159140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044159140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044159140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044159141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044159142 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044159143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044159143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044159143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:00.128519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Terminating (SIGTERM) 04:42:00.169840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Terminating (SIGTERM) 04:42:00.212020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9862): Terminating (SIGTERM) 04:42:00.254178 --- ParallelTerminationStrategy: PID 9856 died... 04:42:00.274995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9856): Terminated: ok {rc=0} 04:42:00.321533 --- ParallelTerminationStrategy: PID 9859 died... 04:42:00.341422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9859): Terminated: ok {rc=0} 04:42:00.387800 --- ParallelTerminationStrategy: PID 9862 died... 04:42:00.407758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9862): Terminated: ok {rc=0} 04:42:00.495364 bus /sierra_3: Setting Powered False 04:42:01.600026 bus /sierra_3: Setting Powered False 04:42:02.723129 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 04:42:03.865760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:03.877800 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 04:42:03.944542 tst mo_mt_call_osmux.py: using LAC 38620 04:42:04.065295 tst mo_mt_call_osmux.py: using RAC 115 04:42:04.185623 tst mo_mt_call_osmux.py: using CellId 38620 04:42:04.304330 tst mo_mt_call_osmux.py: using BVCI 38621 04:42:04.415693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:04.426859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:04.437937 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:04.448765 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:04.459829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 04:42:04.470834 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:42:04.585237 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 04:42:04.702456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:05.175108 run create_hlr_db(pid=9869): Launched 04:42:05.304215 bus /sierra_2: Setting Powered False 04:42:06.368823 run create_hlr_db(pid=9869): Terminated: ok {rc=0} 04:42:06.820484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Launched 04:42:07.148270 run osmo-hlr_10.42.42.2(pid=9872): Launched 04:42:07.273407 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:07.838910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Launched 04:42:08.166092 run osmo-stp_10.42.42.5(pid=9875): Launched 04:42:08.290949 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:08.880172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Launched 04:42:09.206975 run osmo-msc_10.42.42.6(pid=9878): Launched 04:42:09.384645 run osmo-stp_10.42.42.5(pid=9875): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] 04:42:09.515492 run osmo-stp_10.42.42.5(pid=9875): stdout: | (launched: 2022-12-14_04:42:08.105822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:09.644904 run osmo-stp_10.42.42.5(pid=9875): stderr: | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044208297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:09.771526 run osmo-stp_10.42.42.5(pid=9875): stdout: | (launched: 2022-12-14_04:42:08.105822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:09.891552 run osmo-stp_10.42.42.5(pid=9875): stderr: | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044208297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044208297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044208298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:10.035377 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9875): Process ended prematurely: osmo-stp_10.42.42.5(pid=9875) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 04:42:10.044471 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:42:10.070953 run osmo-hlr_10.42.42.2(pid=9872): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9872)] 04:42:10.118272 run osmo-hlr_10.42.42.2(pid=9872): stdout: | (launched: 2022-12-14_04:42:07.088056) 04:42:10.167148 run osmo-hlr_10.42.42.2(pid=9872): stderr: | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044207284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044207296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044207305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044207305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044207305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:10.235533 run osmo-msc_10.42.42.6(pid=9878): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9878)] 04:42:10.282484 run osmo-msc_10.42.42.6(pid=9878): stdout: | (launched: 2022-12-14_04:42:09.146963) 04:42:10.331083 run osmo-msc_10.42.42.6(pid=9878): stderr: | [0;m[38;5;43m20221214044209421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044209421 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d8121dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044209421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044209422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044209422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044209422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044209423 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044209424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044209424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044209424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:10.380040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Terminating (SIGTERM) 04:42:10.419231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Terminating (SIGTERM) 04:42:10.458348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Terminating (SIGTERM) 04:42:10.497881 --- ParallelTerminationStrategy: PID 9871 died... 04:42:10.516870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Terminated: ok {rc=0} 04:42:10.560393 --- ParallelTerminationStrategy: PID 9874 died... 04:42:10.578722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Terminated: ok {rc=0} 04:42:10.622113 --- ParallelTerminationStrategy: PID 9877 died... 04:42:10.640628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Terminated: ok {rc=0} 04:42:10.725039 bus /sierra_3: Setting Powered False 04:42:11.825530 bus /sierra_3: Setting Powered False 04:42:12.939927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 04:42:14.199345 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:14.207301 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 04:42:14.240387 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 04:42:14.268711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 04:42:14.322906 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 04:42:14.356572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 04:42:14.383998 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 04:42:14.936020 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 04:42:14.988810 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.000430 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:42:15.069396 tst mo_mt_call.py: using LAC 38621 04:42:15.193312 tst mo_mt_call.py: using RAC 116 04:42:15.311835 tst mo_mt_call.py: using CellId 38621 04:42:15.428695 tst mo_mt_call.py: using BVCI 38622 04:42:15.538077 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.549523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.560504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.571429 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.582412 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:15.593453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:15.706989 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:15.828385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:16.348742 run create_hlr_db(pid=9883): Launched 04:42:16.509180 bus /sierra_2: Setting Powered False 04:42:17.573533 run create_hlr_db(pid=9883): Terminated: ok {rc=0} 04:42:18.023773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Launched 04:42:18.350602 run osmo-hlr_10.42.42.2(pid=9886): Launched 04:42:18.475398 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:19.037743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Launched 04:42:19.366141 run osmo-stp_10.42.42.5(pid=9889): Launched 04:42:19.489944 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:20.078952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Launched 04:42:20.405670 run osmo-msc_10.42.42.6(pid=9892): Launched 04:42:20.588011 run osmo-stp_10.42.42.5(pid=9889): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] 04:42:20.725964 run osmo-stp_10.42.42.5(pid=9889): stdout: | (launched: 2022-12-14_04:42:19.305403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:20.864312 run osmo-stp_10.42.42.5(pid=9889): stderr: | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044219499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:21.001069 run osmo-stp_10.42.42.5(pid=9889): stdout: | (launched: 2022-12-14_04:42:19.305403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:21.131065 run osmo-stp_10.42.42.5(pid=9889): stderr: | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044219498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044219499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044219499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:21.285959 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9889): Process ended prematurely: osmo-stp_10.42.42.5(pid=9889) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 04:42:21.295587 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 04:42:21.323312 run osmo-hlr_10.42.42.2(pid=9886): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9886)] 04:42:21.373731 run osmo-hlr_10.42.42.2(pid=9886): stdout: | (launched: 2022-12-14_04:42:18.290558) 04:42:21.425538 run osmo-hlr_10.42.42.2(pid=9886): stderr: | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044218488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044218501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044218509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044218510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044218510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:21.497969 run osmo-msc_10.42.42.6(pid=9892): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9892)] 04:42:21.547666 run osmo-msc_10.42.42.6(pid=9892): stdout: | (launched: 2022-12-14_04:42:20.345385) 04:42:21.599665 run osmo-msc_10.42.42.6(pid=9892): stderr: | [0;m[38;5;43m20221214044220667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044220667 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c9ec0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044220667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044220667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044220667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044220668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044220669 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044220670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044220670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044220670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:21.651439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Terminating (SIGTERM) 04:42:21.693415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Terminating (SIGTERM) 04:42:21.735784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Terminating (SIGTERM) 04:42:21.778121 --- ParallelTerminationStrategy: PID 9885 died... 04:42:21.798408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Terminated: ok {rc=0} 04:42:21.844730 --- ParallelTerminationStrategy: PID 9888 died... 04:42:21.864676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Terminated: ok {rc=0} 04:42:21.910879 --- ParallelTerminationStrategy: PID 9891 died... 04:42:21.930743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Terminated: ok {rc=0} 04:42:22.018430 bus /sierra_3: Setting Powered False 04:42:23.117293 bus /sierra_3: Setting Powered False 04:42:24.232671 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 04:42:25.378875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.390695 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 04:42:25.456166 tst mo_mt_call_osmux.py: using LAC 38622 04:42:25.573642 tst mo_mt_call_osmux.py: using RAC 117 04:42:25.690645 tst mo_mt_call_osmux.py: using CellId 38622 04:42:25.809182 tst mo_mt_call_osmux.py: using BVCI 38623 04:42:25.918363 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.929637 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.940620 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.951667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.962837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 04:42:25.973894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:26.089406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 04:42:26.212572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:26.715984 run create_hlr_db(pid=9894): Launched 04:42:26.841554 bus /sierra_2: Setting Powered False 04:42:27.906098 run create_hlr_db(pid=9894): Terminated: ok {rc=0} 04:42:28.340451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Launched 04:42:28.646273 run osmo-hlr_10.42.42.2(pid=9897): Launched 04:42:28.764268 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:29.304579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Launched 04:42:29.609856 run osmo-stp_10.42.42.5(pid=9900): Launched 04:42:29.725487 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:30.275855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Launched 04:42:30.579945 run osmo-msc_10.42.42.6(pid=9903): Launched 04:42:30.749603 run osmo-stp_10.42.42.5(pid=9900): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] 04:42:30.898507 run osmo-stp_10.42.42.5(pid=9900): stdout: | (launched: 2022-12-14_04:42:29.552581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:31.110102 run osmo-stp_10.42.42.5(pid=9900): stderr: | [0;m[38;5;43m20221214044229723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044229724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044229724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044229724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:31.250303 run osmo-stp_10.42.42.5(pid=9900): stdout: | (launched: 2022-12-14_04:42:29.552581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:31.384819 run osmo-stp_10.42.42.5(pid=9900): stderr: | [0;m[38;5;43m20221214044229723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044229724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044229724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044229724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044229725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:31.546924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9900): Process ended prematurely: osmo-stp_10.42.42.5(pid=9900) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 04:42:31.558026 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:42:31.587724 run osmo-hlr_10.42.42.2(pid=9897): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9897)] 04:42:31.644466 run osmo-hlr_10.42.42.2(pid=9897): stdout: | (launched: 2022-12-14_04:42:28.589706) 04:42:31.699729 run osmo-hlr_10.42.42.2(pid=9897): stderr: | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044228764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044228776 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044228784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044228784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044228784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:31.775545 run osmo-msc_10.42.42.6(pid=9903): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9903)] 04:42:31.830508 run osmo-msc_10.42.42.6(pid=9903): stdout: | (launched: 2022-12-14_04:42:30.523296) 04:42:31.885767 run osmo-msc_10.42.42.6(pid=9903): stderr: | [0;m[38;5;43m20221214044230793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044230793 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb305c3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044230793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044230794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044230794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044230794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044230796 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044230796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044230796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044230796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:31.941078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Terminating (SIGTERM) 04:42:31.985189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Terminating (SIGTERM) 04:42:32.032881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Terminating (SIGTERM) 04:42:32.080577 --- ParallelTerminationStrategy: PID 9896 died... 04:42:32.103045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Terminated: ok {rc=0} 04:42:32.154500 --- ParallelTerminationStrategy: PID 9899 died... 04:42:32.175333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Terminated: ok {rc=0} 04:42:32.223987 --- ParallelTerminationStrategy: PID 9902 died... 04:42:32.244320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Terminated: ok {rc=0} 04:42:32.334089 bus /sierra_3: Setting Powered False 04:42:33.430605 bus /sierra_3: Setting Powered False 04:42:34.544328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 04:42:35.792453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:35.800100 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 04:42:35.832041 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 04:42:35.858846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 04:42:35.910536 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 04:42:35.943125 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 04:42:35.970705 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 04:42:36.520007 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 04:42:36.568760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:36.580296 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:42:36.648228 tst mo_mt_call.py: using LAC 38623 04:42:36.768444 tst mo_mt_call.py: using RAC 118 04:42:36.889527 tst mo_mt_call.py: using CellId 38623 04:42:37.008567 tst mo_mt_call.py: using BVCI 38624 04:42:37.120711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:37.131887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:37.142805 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:37.153755 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:37.165324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:37.176813 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:37.297483 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:37.417600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:37.920393 run create_hlr_db(pid=9908): Launched 04:42:38.046310 bus /sierra_2: Setting Powered False 04:42:39.111041 run create_hlr_db(pid=9908): Terminated: ok {rc=0} 04:42:39.545094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Launched 04:42:39.849470 run osmo-hlr_10.42.42.2(pid=9911): Launched 04:42:39.965192 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:40.488698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Launched 04:42:40.791970 run osmo-stp_10.42.42.5(pid=9914): Launched 04:42:40.907184 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:41.454827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Launched 04:42:41.757732 run osmo-msc_10.42.42.6(pid=9917): Launched 04:42:41.928038 run osmo-stp_10.42.42.5(pid=9914): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] 04:42:42.056263 run osmo-stp_10.42.42.5(pid=9914): stdout: | (launched: 2022-12-14_04:42:40.735672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:42.184898 run osmo-stp_10.42.42.5(pid=9914): stderr: | [0;m[38;5;43m20221214044240907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044240908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044240908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044240908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:42.312237 run osmo-stp_10.42.42.5(pid=9914): stdout: | (launched: 2022-12-14_04:42:40.735672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:42.432379 run osmo-stp_10.42.42.5(pid=9914): stderr: | [0;m[38;5;43m20221214044240907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044240908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044240908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044240908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044240909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:42.576372 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9914): Process ended prematurely: osmo-stp_10.42.42.5(pid=9914) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 04:42:42.585417 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:42:42.611798 run osmo-hlr_10.42.42.2(pid=9911): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9911)] 04:42:42.659162 run osmo-hlr_10.42.42.2(pid=9911): stdout: | (launched: 2022-12-14_04:42:39.792422) 04:42:42.708447 run osmo-hlr_10.42.42.2(pid=9911): stderr: | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044239970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044239983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044239991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044239992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044239992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:42.777404 run osmo-msc_10.42.42.6(pid=9917): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9917)] 04:42:42.824672 run osmo-msc_10.42.42.6(pid=9917): stdout: | (launched: 2022-12-14_04:42:41.701256) 04:42:42.873518 run osmo-msc_10.42.42.6(pid=9917): stderr: | [0;m[38;5;43m20221214044241973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044241973 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b2462fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044241973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044241973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044241973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044241973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044241975 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044241976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044241976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044241976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:42.922634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Terminating (SIGTERM) 04:42:42.961869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Terminating (SIGTERM) 04:42:43.001061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Terminating (SIGTERM) 04:42:43.040677 --- ParallelTerminationStrategy: PID 9910 died... 04:42:43.059979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Terminated: ok {rc=0} 04:42:43.103648 --- ParallelTerminationStrategy: PID 9913 died... 04:42:43.122438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Terminated: ok {rc=0} 04:42:43.165897 --- ParallelTerminationStrategy: PID 9916 died... 04:42:43.184565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Terminated: ok {rc=0} 04:42:43.268180 bus /sierra_3: Setting Powered False 04:42:44.363069 bus /sierra_3: Setting Powered False 04:42:45.477956 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 04:42:46.627072 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:46.640079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 04:42:46.712651 tst mo_mt_call_osmux.py: using LAC 38624 04:42:46.834315 tst mo_mt_call_osmux.py: using RAC 119 04:42:46.954129 tst mo_mt_call_osmux.py: using CellId 38624 04:42:47.129520 tst mo_mt_call_osmux.py: using BVCI 38625 04:42:47.272667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:47.285737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:47.298354 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:47.311113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:47.324320 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 04:42:47.337268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:47.459076 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 04:42:47.580865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:48.052881 run create_hlr_db(pid=9919): Launched 04:42:48.176895 bus /sierra_2: Setting Powered False 04:42:49.238057 run create_hlr_db(pid=9919): Terminated: ok {rc=0} 04:42:49.682904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Launched 04:42:50.010618 run osmo-hlr_10.42.42.2(pid=9922): Launched 04:42:50.137035 run osmo-stp_10.42.42.5: Starting osmo-stp 04:42:50.702239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Launched 04:42:51.027697 run osmo-stp_10.42.42.5(pid=9925): Launched 04:42:51.154267 run osmo-msc_10.42.42.6: Starting osmo-msc 04:42:51.742712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Launched 04:42:52.069648 run osmo-msc_10.42.42.6(pid=9928): Launched 04:42:52.251882 run osmo-stp_10.42.42.5(pid=9925): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] 04:42:52.389236 run osmo-stp_10.42.42.5(pid=9925): stdout: | (launched: 2022-12-14_04:42:50.967586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:52.527146 run osmo-stp_10.42.42.5(pid=9925): stderr: | [0;m[38;5;43m20221214044251157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044251158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044251158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044251158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:52.663331 run osmo-stp_10.42.42.5(pid=9925): stdout: | (launched: 2022-12-14_04:42:50.967586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:42:52.792614 run osmo-stp_10.42.42.5(pid=9925): stderr: | [0;m[38;5;43m20221214044251157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044251158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044251158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044251158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044251159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:42:52.947605 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9925): Process ended prematurely: osmo-stp_10.42.42.5(pid=9925) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 04:42:52.957281 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 04:42:52.985028 run osmo-hlr_10.42.42.2(pid=9922): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9922)] 04:42:53.036185 run osmo-hlr_10.42.42.2(pid=9922): stdout: | (launched: 2022-12-14_04:42:49.950567) 04:42:53.087897 run osmo-hlr_10.42.42.2(pid=9922): stderr: | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044250149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044250159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044250168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044250168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044250168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:42:53.161173 run osmo-msc_10.42.42.6(pid=9928): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9928)] 04:42:53.210904 run osmo-msc_10.42.42.6(pid=9928): stdout: | (launched: 2022-12-14_04:42:52.009117) 04:42:53.262694 run osmo-msc_10.42.42.6(pid=9928): stderr: | [0;m[38;5;43m20221214044252328 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044252328 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8cd836dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044252328 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044252328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044252329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044252329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044252330 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044252331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044252331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044252331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:42:53.314316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Terminating (SIGTERM) 04:42:53.356156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Terminating (SIGTERM) 04:42:53.398446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Terminating (SIGTERM) 04:42:53.440166 --- ParallelTerminationStrategy: PID 9921 died... 04:42:53.460218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Terminated: ok {rc=0} 04:42:53.506590 --- ParallelTerminationStrategy: PID 9924 died... 04:42:53.526374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Terminated: ok {rc=0} 04:42:53.572245 --- ParallelTerminationStrategy: PID 9927 died... 04:42:53.592142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Terminated: ok {rc=0} 04:42:53.679851 bus /sierra_3: Setting Powered False 04:42:54.778011 bus /sierra_3: Setting Powered False 04:42:55.894164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 04:42:57.152189 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:42:57.160368 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 04:42:57.193639 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 04:42:57.221949 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 04:42:57.276489 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 04:42:57.309690 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 04:42:57.337467 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 04:42:57.888559 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 04:42:57.941221 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:57.952827 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:42:58.021580 tst mo_mt_call.py: using LAC 38625 04:42:58.141450 tst mo_mt_call.py: using RAC 120 04:42:58.264343 tst mo_mt_call.py: using CellId 38625 04:42:58.382104 tst mo_mt_call.py: using BVCI 38626 04:42:58.493927 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:58.505347 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:58.516407 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:58.527486 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:58.538557 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:42:58.549584 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:58.668789 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:42:58.786340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:42:59.258864 run create_hlr_db(pid=9933): Launched 04:42:59.384413 bus /sierra_2: Setting Powered False 04:43:00.446082 run create_hlr_db(pid=9933): Terminated: ok {rc=0} 04:43:00.901680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Launched 04:43:01.261697 run osmo-hlr_10.42.42.2(pid=9936): Launched 04:43:01.476105 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:02.131224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Launched 04:43:02.453540 run osmo-stp_10.42.42.5(pid=9939): Launched 04:43:02.572683 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:03.128204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Launched 04:43:03.433372 run osmo-msc_10.42.42.6(pid=9942): Launched 04:43:03.602768 run osmo-stp_10.42.42.5(pid=9939): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] 04:43:03.730678 run osmo-stp_10.42.42.5(pid=9939): stdout: | (launched: 2022-12-14_04:43:02.396640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:03.858863 run osmo-stp_10.42.42.5(pid=9939): stderr: | [0;m[38;5;43m20221214044302565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044302565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044302566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044302566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044302566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044302567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044302567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:03.984626 run osmo-stp_10.42.42.5(pid=9939): stdout: | (launched: 2022-12-14_04:43:02.396640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:04.104559 run osmo-stp_10.42.42.5(pid=9939): stderr: | [0;m[38;5;43m20221214044302565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044302565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044302566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044302566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044302566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044302567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044302567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:04.248134 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9939): Process ended prematurely: osmo-stp_10.42.42.5(pid=9939) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 04:43:04.257026 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:43:04.283318 run osmo-hlr_10.42.42.2(pid=9936): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9936)] 04:43:04.330922 run osmo-hlr_10.42.42.2(pid=9936): stdout: | (launched: 2022-12-14_04:43:01.200887) 04:43:04.379958 run osmo-hlr_10.42.42.2(pid=9936): stderr: | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044301574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044301596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044301623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044301624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044301624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:04.448651 run osmo-msc_10.42.42.6(pid=9942): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9942)] 04:43:04.496156 run osmo-msc_10.42.42.6(pid=9942): stdout: | (launched: 2022-12-14_04:43:03.376860) 04:43:04.545120 run osmo-msc_10.42.42.6(pid=9942): stderr: | [0;m[38;5;43m20221214044303647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044303647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa3e120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044303647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044303647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044303648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044303648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044303650 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044303650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044303650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044303650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:04.594226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Terminating (SIGTERM) 04:43:04.633515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Terminating (SIGTERM) 04:43:04.672705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Terminating (SIGTERM) 04:43:04.712171 --- ParallelTerminationStrategy: PID 9935 died... 04:43:04.731137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Terminated: ok {rc=0} 04:43:04.774442 --- ParallelTerminationStrategy: PID 9938 died... 04:43:04.792597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Terminated: ok {rc=0} 04:43:04.836136 --- ParallelTerminationStrategy: PID 9941 died... 04:43:04.854587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Terminated: ok {rc=0} 04:43:04.939322 bus /sierra_3: Setting Powered False 04:43:06.037823 bus /sierra_3: Setting Powered False 04:43:07.153196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 04:43:08.298548 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.310490 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 04:43:08.376490 tst mo_mt_call_osmux.py: using LAC 38626 04:43:08.496161 tst mo_mt_call_osmux.py: using RAC 121 04:43:08.614515 tst mo_mt_call_osmux.py: using CellId 38626 04:43:08.735185 tst mo_mt_call_osmux.py: using BVCI 38627 04:43:08.846329 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.857603 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.868688 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.879680 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.890792 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 04:43:08.901868 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:09.016828 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 04:43:09.136888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:09.641819 run create_hlr_db(pid=9944): Launched 04:43:09.768535 bus /sierra_2: Setting Powered False 04:43:10.833072 run create_hlr_db(pid=9944): Terminated: ok {rc=0} 04:43:11.285628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Launched 04:43:11.612025 run osmo-hlr_10.42.42.2(pid=9947): Launched 04:43:11.737696 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:12.303355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Launched 04:43:12.629546 run osmo-stp_10.42.42.5(pid=9950): Launched 04:43:12.755460 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:13.346688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Launched 04:43:13.673190 run osmo-msc_10.42.42.6(pid=9953): Launched 04:43:13.855942 run osmo-stp_10.42.42.5(pid=9950): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] 04:43:13.993580 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-14_04:43:12.569136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:14.131829 run osmo-stp_10.42.42.5(pid=9950): stderr: | [0;m[38;5;43m20221214044312761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044312761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044312762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044312762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044312762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044312762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044312763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:14.267703 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-14_04:43:12.569136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:14.397198 run osmo-stp_10.42.42.5(pid=9950): stderr: | [0;m[38;5;43m20221214044312761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044312761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044312762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044312762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044312762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044312762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044312763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:14.551917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 04:43:14.561763 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:43:14.589590 run osmo-hlr_10.42.42.2(pid=9947): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9947)] 04:43:14.640076 run osmo-hlr_10.42.42.2(pid=9947): stdout: | (launched: 2022-12-14_04:43:11.551756) 04:43:14.691617 run osmo-hlr_10.42.42.2(pid=9947): stderr: | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044311749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044311761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044311769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044311770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044311770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:14.764055 run osmo-msc_10.42.42.6(pid=9953): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9953)] 04:43:14.813706 run osmo-msc_10.42.42.6(pid=9953): stdout: | (launched: 2022-12-14_04:43:13.612854) 04:43:14.865676 run osmo-msc_10.42.42.6(pid=9953): stderr: | [0;m[38;5;43m20221214044313932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044313932 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25978a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044313933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044313933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044313933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044313933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044313935 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044313935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044313935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044313935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:14.917805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminating (SIGTERM) 04:43:14.959286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminating (SIGTERM) 04:43:15.001769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Terminating (SIGTERM) 04:43:15.043818 --- ParallelTerminationStrategy: PID 9946 died... 04:43:15.064478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminated: ok {rc=0} 04:43:15.111111 --- ParallelTerminationStrategy: PID 9949 died... 04:43:15.131494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminated: ok {rc=0} 04:43:15.177697 --- ParallelTerminationStrategy: PID 9952 died... 04:43:15.197647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Terminated: ok {rc=0} 04:43:15.286140 bus /sierra_3: Setting Powered False 04:43:16.380485 bus /sierra_3: Setting Powered False 04:43:17.494835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 04:43:18.750385 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:18.758578 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:43:18.791979 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 04:43:18.819960 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:43:18.875646 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:43:18.907907 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 04:43:18.935183 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:43:19.488770 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 04:43:19.542227 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:19.554107 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:43:19.631212 tst mo_mt_call.py: using LAC 38627 04:43:19.769457 tst mo_mt_call.py: using RAC 122 04:43:19.903112 tst mo_mt_call.py: using CellId 38627 04:43:20.030601 tst mo_mt_call.py: using BVCI 38628 04:43:20.150663 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:20.162383 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:20.174047 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:20.185562 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:20.197451 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:20.209277 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:20.326043 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:20.443557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:20.917281 run create_hlr_db(pid=9959): Launched 04:43:21.042231 bus /sierra_2: Setting Powered False 04:43:22.103206 run create_hlr_db(pid=9959): Terminated: ok {rc=0} 04:43:22.526341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Launched 04:43:22.833003 run osmo-hlr_10.42.42.2(pid=9962): Launched 04:43:22.947334 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:23.484287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Launched 04:43:23.789185 run osmo-stp_10.42.42.5(pid=9965): Launched 04:43:23.905469 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:24.454534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9967): Launched 04:43:24.757640 run osmo-msc_10.42.42.6(pid=9968): Launched 04:43:24.926858 run osmo-stp_10.42.42.5(pid=9965): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] 04:43:25.054719 run osmo-stp_10.42.42.5(pid=9965): stdout: | (launched: 2022-12-14_04:43:23.731851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:25.182974 run osmo-stp_10.42.42.5(pid=9965): stderr: | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044323906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:25.308855 run osmo-stp_10.42.42.5(pid=9965): stdout: | (launched: 2022-12-14_04:43:23.731851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:25.428839 run osmo-stp_10.42.42.5(pid=9965): stderr: | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044323905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044323906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044323906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:25.572226 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9965): Process ended prematurely: osmo-stp_10.42.42.5(pid=9965) [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 04:43:25.581073 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 04:43:25.607303 run osmo-hlr_10.42.42.2(pid=9962): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9962)] 04:43:25.654663 run osmo-hlr_10.42.42.2(pid=9962): stdout: | (launched: 2022-12-14_04:43:22.776612) 04:43:25.704379 run osmo-hlr_10.42.42.2(pid=9962): stderr: | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044322953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044322965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044322974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044322974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044322975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:25.773108 run osmo-msc_10.42.42.6(pid=9968): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9968)] 04:43:25.820272 run osmo-msc_10.42.42.6(pid=9968): stdout: | (launched: 2022-12-14_04:43:24.701297) 04:43:25.869520 run osmo-msc_10.42.42.6(pid=9968): stderr: | [0;m[38;5;43m20221214044324970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044324970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3391f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044324971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044324971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044324971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044324971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044324973 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044324973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044324973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044324973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:25.918723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Terminating (SIGTERM) 04:43:25.957727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Terminating (SIGTERM) 04:43:25.996643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9967): Terminating (SIGTERM) 04:43:26.035803 --- ParallelTerminationStrategy: PID 9961 died... 04:43:26.054852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9961): Terminated: ok {rc=0} 04:43:26.098436 --- ParallelTerminationStrategy: PID 9964 died... 04:43:26.116852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9964): Terminated: ok {rc=0} 04:43:26.160431 --- ParallelTerminationStrategy: PID 9967 died... 04:43:26.179027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9967): Terminated: ok {rc=0} 04:43:26.263765 bus /sierra_3: Setting Powered False 04:43:27.362144 bus /sierra_3: Setting Powered False 04:43:28.477895 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 04:43:29.622795 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:29.634727 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:43:29.701316 tst mo_mt_call_osmux.py: using LAC 38628 04:43:29.821527 tst mo_mt_call_osmux.py: using RAC 123 04:43:29.941774 tst mo_mt_call_osmux.py: using CellId 38628 04:43:30.071097 tst mo_mt_call_osmux.py: using BVCI 38629 04:43:30.190391 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:30.202385 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:30.214326 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:30.225944 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:30.238331 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 04:43:30.250716 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:30.367438 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:43:30.487822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:31.021051 run create_hlr_db(pid=9970): Launched 04:43:31.183029 bus /sierra_2: Setting Powered False 04:43:32.243168 run create_hlr_db(pid=9970): Terminated: ok {rc=0} 04:43:32.702988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Launched 04:43:33.008614 run osmo-hlr_10.42.42.2(pid=9973): Launched 04:43:33.123224 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:33.646310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Launched 04:43:33.949080 run osmo-stp_10.42.42.5(pid=9976): Launched 04:43:34.064149 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:34.614719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Launched 04:43:34.919622 run osmo-msc_10.42.42.6(pid=9979): Launched 04:43:35.090510 run osmo-stp_10.42.42.5(pid=9976): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] 04:43:35.218413 run osmo-stp_10.42.42.5(pid=9976): stdout: | (launched: 2022-12-14_04:43:33.892639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:35.345925 run osmo-stp_10.42.42.5(pid=9976): stderr: | [0;m[38;5;43m20221214044334064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044334064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044334065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044334065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:35.471758 run osmo-stp_10.42.42.5(pid=9976): stdout: | (launched: 2022-12-14_04:43:33.892639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:35.591613 run osmo-stp_10.42.42.5(pid=9976): stderr: | [0;m[38;5;43m20221214044334064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044334064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044334065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044334065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044334066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:35.735298 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9976): Process ended prematurely: osmo-stp_10.42.42.5(pid=9976) [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 04:43:35.744014 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 04:43:35.770461 run osmo-hlr_10.42.42.2(pid=9973): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9973)] 04:43:35.817999 run osmo-hlr_10.42.42.2(pid=9973): stdout: | (launched: 2022-12-14_04:43:32.952339) 04:43:35.867143 run osmo-hlr_10.42.42.2(pid=9973): stderr: | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044333129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044333141 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044333150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044333150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044333150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:35.935762 run osmo-msc_10.42.42.6(pid=9979): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9979)] 04:43:35.982985 run osmo-msc_10.42.42.6(pid=9979): stdout: | (launched: 2022-12-14_04:43:34.862963) 04:43:36.031846 run osmo-msc_10.42.42.6(pid=9979): stderr: | [0;m[38;5;43m20221214044335134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044335134 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96c5832c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044335134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044335134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044335134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044335135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044335136 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044335137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044335137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044335137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:36.081340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Terminating (SIGTERM) 04:43:36.120678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Terminating (SIGTERM) 04:43:36.159911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Terminating (SIGTERM) 04:43:36.199290 --- ParallelTerminationStrategy: PID 9972 died... 04:43:36.218417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Terminated: ok {rc=0} 04:43:36.261976 --- ParallelTerminationStrategy: PID 9975 died... 04:43:36.280541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Terminated: ok {rc=0} 04:43:36.323872 --- ParallelTerminationStrategy: PID 9978 died... 04:43:36.342538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Terminated: ok {rc=0} 04:43:36.429108 bus /sierra_3: Setting Powered False 04:43:37.528158 bus /sierra_3: Setting Powered False 04:43:38.643908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:43:39.899684 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:43:39.907320 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:43:39.941079 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 04:43:39.969077 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 04:43:40.023558 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:43:40.057831 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 04:43:40.086093 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 04:43:40.634187 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 04:43:40.683759 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:40.695287 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:43:40.744342 tst mo_mt_call.py: using LAC 38629 04:43:40.865825 tst mo_mt_call.py: using RAC 124 04:43:40.987832 tst mo_mt_call.py: using CellId 38629 04:43:41.108407 tst mo_mt_call.py: using BVCI 38630 04:43:41.219641 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:41.231370 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:41.242529 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:41.253732 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:41.265114 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:41.276388 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:41.390768 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:41.506449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:41.977388 run create_hlr_db(pid=9984): Launched 04:43:42.101804 bus /sierra_2: Setting Powered False 04:43:43.162466 run create_hlr_db(pid=9984): Terminated: ok {rc=0} 04:43:43.584691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9986): Launched 04:43:43.889379 run osmo-hlr_10.42.42.2(pid=9987): Launched 04:43:44.005250 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:44.542044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9989): Launched 04:43:44.846076 run osmo-stp_10.42.42.5(pid=9990): Launched 04:43:44.963154 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:45.512594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9992): Launched 04:43:45.816177 run osmo-msc_10.42.42.6(pid=9993): Launched 04:43:46.188266 run osmo-stp_10.42.42.5(pid=9990): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9990)] 04:43:46.430049 run osmo-stp_10.42.42.5(pid=9990): stdout: | (launched: 2022-12-14_04:43:44.789211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:46.595797 run osmo-stp_10.42.42.5(pid=9990): stderr: | [0;m[38;5;43m20221214044344957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044344957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044344958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044344958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044344958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044344959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044344959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:46.738202 run osmo-stp_10.42.42.5(pid=9990): stdout: | (launched: 2022-12-14_04:43:44.789211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:46.872720 run osmo-stp_10.42.42.5(pid=9990): stderr: | [0;m[38;5;43m20221214044344957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044344957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044344958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044344958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044344958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044344959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044344959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:47.033373 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9990): Process ended prematurely: osmo-stp_10.42.42.5(pid=9990) [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9990)] [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 04:43:47.044141 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 04:43:47.073766 run osmo-hlr_10.42.42.2(pid=9987): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9987)] 04:43:47.128395 run osmo-hlr_10.42.42.2(pid=9987): stdout: | (launched: 2022-12-14_04:43:43.832060) 04:43:47.190040 run osmo-hlr_10.42.42.2(pid=9987): stderr: | [0;m[1;31m20221214044344007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044344008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044344008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044344008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044344008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044344008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044344020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044344030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044344030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044344030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:47.267690 run osmo-msc_10.42.42.6(pid=9993): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9993)] 04:43:47.316799 run osmo-msc_10.42.42.6(pid=9993): stdout: | (launched: 2022-12-14_04:43:45.759216) 04:43:47.366840 run osmo-msc_10.42.42.6(pid=9993): stderr: | [0;m[38;5;43m20221214044346149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044346149 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f35733c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044346149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044346149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044346149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044346150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044346151 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044346152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044346152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044346152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:47.416771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9986): Terminating (SIGTERM) 04:43:47.456481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9989): Terminating (SIGTERM) 04:43:47.496164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9992): Terminating (SIGTERM) 04:43:47.536336 --- ParallelTerminationStrategy: PID 9986 died... 04:43:47.555790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9986): Terminated: ok {rc=0} 04:43:47.599932 --- ParallelTerminationStrategy: PID 9989 died... 04:43:47.618891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9989): Terminated: ok {rc=0} 04:43:47.662731 --- ParallelTerminationStrategy: PID 9992 died... 04:43:47.681970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9992): Terminated: ok {rc=0} 04:43:47.767782 bus /sierra_3: Setting Powered False 04:43:48.868119 bus /sierra_3: Setting Powered False 04:43:49.984097 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 04:43:51.130170 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.142527 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:43:51.192522 tst mo_mt_call_osmux.py: using LAC 38630 04:43:51.313353 tst mo_mt_call_osmux.py: using RAC 125 04:43:51.432753 tst mo_mt_call_osmux.py: using CellId 38630 04:43:51.552282 tst mo_mt_call_osmux.py: using BVCI 38631 04:43:51.664465 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.676131 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.687530 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.698812 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.710449 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 04:43:51.722040 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:51.837742 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 04:43:51.957055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:43:52.464090 run create_hlr_db(pid=9995): Launched 04:43:52.588206 bus /sierra_2: Setting Powered False 04:43:53.653129 run create_hlr_db(pid=9995): Terminated: ok {rc=0} 04:43:54.105402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Launched 04:43:54.431581 run osmo-hlr_10.42.42.2(pid=9998): Launched 04:43:54.557913 run osmo-stp_10.42.42.5: Starting osmo-stp 04:43:55.118563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Launched 04:43:55.446430 run osmo-stp_10.42.42.5(pid=10001): Launched 04:43:55.571774 run osmo-msc_10.42.42.6: Starting osmo-msc 04:43:56.159549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Launched 04:43:56.487352 run osmo-msc_10.42.42.6(pid=10004): Launched 04:43:56.672255 run osmo-stp_10.42.42.5(pid=10001): ERR: Terminated: ERROR {rc=1} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] 04:43:56.809556 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-14_04:43:55.385854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:56.946800 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044355579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:57.083481 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-14_04:43:55.385854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:43:57.214753 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044355579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044355579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044355580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:43:57.370400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 04:43:57.379923 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 04:43:57.407894 run osmo-hlr_10.42.42.2(pid=9998): ERR: Terminated: ERROR {rc=237} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9998)] 04:43:57.458204 run osmo-hlr_10.42.42.2(pid=9998): stdout: | (launched: 2022-12-14_04:43:54.371636) 04:43:57.510268 run osmo-hlr_10.42.42.2(pid=9998): stderr: | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044354567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044354580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044354589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044354589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044354589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:43:57.582542 run osmo-msc_10.42.42.6(pid=10004): ERR: Terminated: ERROR {rc=2} [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10004)] 04:43:57.632277 run osmo-msc_10.42.42.6(pid=10004): stdout: | (launched: 2022-12-14_04:43:56.427050) 04:43:57.683990 run osmo-msc_10.42.42.6(pid=10004): stderr: | [0;m[38;5;43m20221214044356748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044356749 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f23da207c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044356749 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044356749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044356749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044356749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044356751 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044356751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044356751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044356751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:43:57.736470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminating (SIGTERM) 04:43:57.778215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminating (SIGTERM) 04:43:57.820414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Terminating (SIGTERM) 04:43:57.862977 --- ParallelTerminationStrategy: PID 9997 died... 04:43:57.883321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminated: ok {rc=0} 04:43:57.929715 --- ParallelTerminationStrategy: PID 10000 died... 04:43:57.949488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminated: ok {rc=0} 04:43:57.996530 --- ParallelTerminationStrategy: PID 10003 died... 04:43:58.016566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Terminated: ok {rc=0} 04:43:58.104915 bus /sierra_3: Setting Powered False 04:43:59.204940 bus /sierra_3: Setting Powered False 04:44:00.321235 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 emergency:nanobts+band-900 --------------------------------------------------------------------- 04:44:01.582848 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:44:01.591319 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:44:01.632475 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 04:44:01.664269 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:44:01.766428 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:44:01.807301 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 04:44:01.841726 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:44:02.405849 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2399 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 04:44:02.411565 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.422741 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:02.470553 tst emergency_mo_mt_call.py: using LAC 38631 04:44:02.588051 tst emergency_mo_mt_call.py: using RAC 126 04:44:02.711207 tst emergency_mo_mt_call.py: using CellId 38631 04:44:02.826872 tst emergency_mo_mt_call.py: using BVCI 38632 04:44:02.934418 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.945465 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.955889 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.966397 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.976928 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:02.987831 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:03.108221 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:03.223633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:03.687295 run create_hlr_db(pid=10009): Launched 04:44:03.808698 bus /sierra_2: Setting Powered False 04:44:04.868372 run create_hlr_db(pid=10009): Terminated: ok {rc=0} 04:44:05.285938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10011): Launched 04:44:05.584079 run osmo-hlr_10.42.42.2(pid=10012): Launched 04:44:05.698007 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:06.226649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10014): Launched 04:44:06.523459 run osmo-stp_10.42.42.5(pid=10015): Launched 04:44:06.648292 tst emergency_mo_mt_call.py: using MSISDN 8506 04:44:06.799363 run osmo-msc_10.42.42.6: Starting osmo-msc 04:44:07.338048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10017): Launched 04:44:07.638590 run osmo-msc_10.42.42.6(pid=10018): Launched 04:44:07.805828 run osmo-stp_10.42.42.5(pid=10015): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10015)] 04:44:07.931737 run osmo-stp_10.42.42.5(pid=10015): stdout: | (launched: 2022-12-14_04:44:06.467844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:08.058048 run osmo-stp_10.42.42.5(pid=10015): stderr: | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044406639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:08.182013 run osmo-stp_10.42.42.5(pid=10015): stdout: | (launched: 2022-12-14_04:44:06.467844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:08.299478 run osmo-stp_10.42.42.5(pid=10015): stderr: | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044406638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044406639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044406639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:08.440662 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10015): Process ended prematurely: osmo-stp_10.42.42.5(pid=10015) [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10015)] [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 04:44:08.448916 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 04:44:08.474981 run osmo-hlr_10.42.42.2(pid=10012): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10012)] 04:44:08.522539 run osmo-hlr_10.42.42.2(pid=10012): stdout: | (launched: 2022-12-14_04:44:05.527686) 04:44:08.571619 run osmo-hlr_10.42.42.2(pid=10012): stderr: | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044405703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044405715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044405724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044405724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044405724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:08.640223 run osmo-msc_10.42.42.6(pid=10018): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10018)] 04:44:08.687537 run osmo-msc_10.42.42.6(pid=10018): stdout: | (launched: 2022-12-14_04:44:07.583064) 04:44:08.736399 run osmo-msc_10.42.42.6(pid=10018): stderr: | [0;m[38;5;43m20221214044407853 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044407853 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5235d6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044407853 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044407853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044407853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044407854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044407856 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044407856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044407856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044407856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:44:08.785597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10011): Terminating (SIGTERM) 04:44:08.825102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10014): Terminating (SIGTERM) 04:44:08.864341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10017): Terminating (SIGTERM) 04:44:08.904304 --- ParallelTerminationStrategy: PID 10011 died... 04:44:08.923407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10011): Terminated: ok {rc=0} 04:44:08.966871 --- ParallelTerminationStrategy: PID 10014 died... 04:44:08.985754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10014): Terminated: ok {rc=0} 04:44:09.029291 --- ParallelTerminationStrategy: PID 10017 died... 04:44:09.047811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10017): Terminated: ok {rc=0} 04:44:09.132617 bus /sierra_3: Setting Powered False 04:44:10.233060 bus /sierra_3: Setting Powered False 04:44:11.348805 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 04:44:12.434800 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:12.446292 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:12.495403 tst emergency_preemptive_call.py: using LAC 38632 04:44:12.613622 tst emergency_preemptive_call.py: using RAC 127 04:44:12.731461 tst emergency_preemptive_call.py: using CellId 38632 04:44:12.850035 tst emergency_preemptive_call.py: using BVCI 38633 04:44:12.958122 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:12.968942 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:12.979569 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:12.990063 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:13.001482 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 04:44:13.012754 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:13.132713 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:13.253263 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:13.371398 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:13.486278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:13.948601 run create_hlr_db(pid=10021): Launched 04:44:14.069354 bus /sierra_2: Setting Powered False 04:44:15.129572 run create_hlr_db(pid=10021): Terminated: ok {rc=0} 04:44:15.567412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Launched 04:44:15.913771 run osmo-hlr_10.42.42.2(pid=10024): Launched 04:44:16.124509 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:16.799829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Launched 04:44:17.126187 run osmo-stp_10.42.42.5(pid=10027): Launched 04:44:17.290504 tst emergency_preemptive_call.py: using MSISDN 8507 04:44:17.503168 run osmo-msc_10.42.42.6: Starting osmo-msc 04:44:18.077365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Launched 04:44:18.398278 run osmo-msc_10.42.42.6(pid=10030): Launched 04:44:18.577985 run osmo-stp_10.42.42.5(pid=10027): ERR: Terminated: ERROR {rc=1} [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] 04:44:18.713429 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-14_04:44:17.066654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:18.849229 run osmo-stp_10.42.42.5(pid=10027): stderr: | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044417373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:18.983926 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-14_04:44:17.066654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:19.111552 run osmo-stp_10.42.42.5(pid=10027): stderr: | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044417372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044417373 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044417373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:19.264457 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 04:44:19.273778 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 04:44:19.301281 run osmo-hlr_10.42.42.2(pid=10024): ERR: Terminated: ERROR {rc=237} [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10024)] 04:44:19.352172 run osmo-hlr_10.42.42.2(pid=10024): stdout: | (launched: 2022-12-14_04:44:15.831161) 04:44:19.404110 run osmo-hlr_10.42.42.2(pid=10024): stderr: | [0;m[1;31m20221214044416059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044416059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044416059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044416059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044416059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044416060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044416080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044416101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044416102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044416102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:19.476766 run osmo-msc_10.42.42.6(pid=10030): ERR: Terminated: ERROR {rc=2} [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10030)] 04:44:19.526464 run osmo-msc_10.42.42.6(pid=10030): stdout: | (launched: 2022-12-14_04:44:18.339152) 04:44:19.578661 run osmo-msc_10.42.42.6(pid=10030): stderr: | [0;m[38;5;43m20221214044418661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044418661 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5e89afac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044418661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044418661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044418661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044418662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044418664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044418664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044418664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044418664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:44:19.630954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminating (SIGTERM) 04:44:19.672470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminating (SIGTERM) 04:44:19.714931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminating (SIGTERM) 04:44:19.757273 --- ParallelTerminationStrategy: PID 10023 died... 04:44:19.777904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminated: ok {rc=0} 04:44:19.824267 --- ParallelTerminationStrategy: PID 10026 died... 04:44:19.844130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminated: ok {rc=0} 04:44:19.890253 --- ParallelTerminationStrategy: PID 10029 died... 04:44:19.910260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminated: ok {rc=0} 04:44:19.998383 bus /sierra_9: Setting Powered False 04:44:21.097533 bus /sierra_9: Setting Powered False 04:44:22.214023 bus /sierra_8: Setting Powered False 04:44:23.311510 bus /sierra_8: Setting Powered False 04:44:24.427262 bus /sierra_3: Setting Powered False 04:44:25.525496 bus /sierra_3: Setting Powered False 04:44:26.642292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900 --------------------------------------------------------------------- 04:44:27.920148 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:44:27.925851 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 04:44:27.959145 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 04:44:27.999523 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 04:44:28.087552 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 04:44:28.120524 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 04:44:28.160419 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 04:44:28.750828 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 04:44:28.800704 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:28.811660 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:28.857200 tst cs_paging_gprs_active.py: using LAC 38633 04:44:28.975183 tst cs_paging_gprs_active.py: using RAC 128 04:44:29.093930 tst cs_paging_gprs_active.py: using CellId 38633 04:44:29.212440 tst cs_paging_gprs_active.py: using BVCI 38634 04:44:29.322261 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.332903 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.343310 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.354560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.365119 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.375514 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.386350 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.396753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:29.407559 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:29.526229 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:29.645096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:44:29.848890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:30.154802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10035): Launched 04:44:30.420484 run iperf3-srv_10.42.42.10(pid=10036): Launched 04:44:30.534492 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:44:30.737904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:31.098386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10037): Launched 04:44:31.395428 run iperf3-srv_10.42.42.10(pid=10038): Launched 04:44:31.568356 tst cs_paging_gprs_active.py:38: start network... 04:44:31.774961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:32.255231 run create_hlr_db(pid=10039): Launched 04:44:32.384059 bus /sierra_2: Setting Powered False 04:44:33.449330 run create_hlr_db(pid=10039): Terminated: ok {rc=0} 04:44:33.903812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10041): Launched 04:44:34.232875 run osmo-hlr_10.42.42.2(pid=10042): Launched 04:44:34.359586 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:34.926064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10044): Launched 04:44:35.254113 run osmo-stp_10.42.42.5(pid=10045): Launched 04:44:35.379117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:35.942712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10047): Launched 04:44:36.067798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:36.344769 run patchelf(pid=10048): Launched 04:44:36.527766 run osmo-stp_10.42.42.5(pid=10045): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10045)] 04:44:36.666403 run osmo-stp_10.42.42.5(pid=10045): stdout: | (launched: 2022-12-14_04:44:35.193617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:36.806093 run osmo-stp_10.42.42.5(pid=10045): stderr: | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044435386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:36.945840 run osmo-stp_10.42.42.5(pid=10045): stdout: | (launched: 2022-12-14_04:44:35.193617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:37.079757 run osmo-stp_10.42.42.5(pid=10045): stderr: | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044435385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044435386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044435386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:37.239620 run patchelf(pid=10048): Terminating (SIGINT) 04:44:37.422303 run patchelf(pid=10048): Terminated: ok {rc=0} 04:44:37.554288 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10045): Process ended prematurely: osmo-stp_10.42.42.5(pid=10045) [trial-2399↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10045)] [trial-2399↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 04:44:37.564467 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:44:37.593131 run osmo-hlr_10.42.42.2(pid=10042): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10042)] 04:44:37.643567 run osmo-hlr_10.42.42.2(pid=10042): stdout: | (launched: 2022-12-14_04:44:34.172490) 04:44:37.695463 run osmo-hlr_10.42.42.2(pid=10042): stderr: | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044434370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044434382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044434391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044434391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044434391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:37.747898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10035): Terminating (SIGTERM) 04:44:37.789578 run iperf3-srv_10.42.42.10(pid=10036): Terminating (SIGTERM) 04:44:37.831479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10037): Terminating (SIGTERM) 04:44:37.873448 run iperf3-srv_10.42.42.10(pid=10038): Terminating (SIGTERM) 04:44:37.915743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10041): Terminating (SIGTERM) 04:44:37.957699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10044): Terminating (SIGTERM) 04:44:37.999914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10047): Terminating (SIGTERM) 04:44:38.042200 --- ParallelTerminationStrategy: PID 10035 died... 04:44:38.062680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10035): Terminated: ok {rc=0} 04:44:38.108862 --- ParallelTerminationStrategy: PID 10036 died... 04:44:38.128510 run iperf3-srv_10.42.42.10(pid=10036): Terminated {rc=256} 04:44:38.174714 --- ParallelTerminationStrategy: PID 10037 died... 04:44:38.194425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10037): Terminated: ok {rc=0} 04:44:38.240397 --- ParallelTerminationStrategy: PID 10038 died... 04:44:38.260201 run iperf3-srv_10.42.42.10(pid=10038): Terminated {rc=256} 04:44:38.305992 --- ParallelTerminationStrategy: PID 10041 died... 04:44:38.325800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10041): Terminated: ok {rc=0} 04:44:38.371739 --- ParallelTerminationStrategy: PID 10044 died... 04:44:38.391454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10044): Terminated: ok {rc=0} 04:44:38.437356 --- ParallelTerminationStrategy: PID 10047 died... 04:44:38.457257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10047): Terminated: ok {rc=0} 04:44:38.545452 bus /gobi_0: Setting Powered False 04:44:39.643776 bus /gobi_0: Setting Powered False 04:44:40.758434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 04:44:41.908430 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:41.920429 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:41.971731 tst iperf3.py: using LAC 38634 04:44:42.099327 tst iperf3.py: using RAC 129 04:44:42.231197 tst iperf3.py: using CellId 38634 04:44:42.350534 tst iperf3.py: using BVCI 38635 04:44:42.460873 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.471719 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.482526 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.493101 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.503389 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.514031 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.524566 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.535442 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:42.546516 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:42.666479 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:42.886198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:43.213750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Launched 04:44:43.498639 run iperf3-srv_10.42.42.10(pid=10050): Launched 04:44:43.622657 tst iperf3.py:8: start network... 04:44:43.842443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:44.352070 run create_hlr_db(pid=10051): Launched 04:44:44.479438 bus /gobi_6: Setting Powered False 04:44:45.540384 run create_hlr_db(pid=10051): Terminated: ok {rc=0} 04:44:46.027009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10053): Launched 04:44:46.351471 run osmo-hlr_10.42.42.2(pid=10054): Launched 04:44:46.584253 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:47.300811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10056): Launched 04:44:47.619582 run osmo-stp_10.42.42.5(pid=10057): Launched 04:44:47.736325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:44:48.263085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10059): Launched 04:44:48.380894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:44:48.638714 run patchelf(pid=10060): Launched 04:44:48.809777 run osmo-stp_10.42.42.5(pid=10057): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10057)] 04:44:48.938291 run osmo-stp_10.42.42.5(pid=10057): stdout: | (launched: 2022-12-14_04:44:47.562888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:49.068338 run osmo-stp_10.42.42.5(pid=10057): stderr: | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044447735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:49.198909 run osmo-stp_10.42.42.5(pid=10057): stdout: | (launched: 2022-12-14_04:44:47.562888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:44:49.324269 run osmo-stp_10.42.42.5(pid=10057): stderr: | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044447734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044447735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044447735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:44:49.471885 run patchelf(pid=10060): Terminating (SIGINT) 04:44:49.642212 run patchelf(pid=10060): Terminated: ok {rc=0} 04:44:49.764800 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10057): Process ended prematurely: osmo-stp_10.42.42.5(pid=10057) [trial-2399↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10057)] [trial-2399↪gprs:nanobts+band-900↪iperf3.py:8] 04:44:49.775080 tst iperf3.py:8: Test FAILED (7.9 sec) 04:44:49.802691 run osmo-hlr_10.42.42.2(pid=10054): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10054)] 04:44:49.850672 run osmo-hlr_10.42.42.2(pid=10054): stdout: | (launched: 2022-12-14_04:44:46.293340) 04:44:49.900376 run osmo-hlr_10.42.42.2(pid=10054): stderr: | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044446496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044446511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044446527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044446527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044446527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:44:49.950628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Terminating (SIGTERM) 04:44:49.990645 run iperf3-srv_10.42.42.10(pid=10050): Terminating (SIGTERM) 04:44:50.030520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10053): Terminating (SIGTERM) 04:44:50.070538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10056): Terminating (SIGTERM) 04:44:50.110489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10059): Terminating (SIGTERM) 04:44:50.150578 --- ParallelTerminationStrategy: PID 10049 died... 04:44:50.170025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Terminated: ok {rc=0} 04:44:50.214231 --- ParallelTerminationStrategy: PID 10050 died... 04:44:50.232893 run iperf3-srv_10.42.42.10(pid=10050): Terminated {rc=256} 04:44:50.277155 --- ParallelTerminationStrategy: PID 10053 died... 04:44:50.296000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10053): Terminated: ok {rc=0} 04:44:50.340193 --- ParallelTerminationStrategy: PID 10056 died... 04:44:50.359202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10056): Terminated: ok {rc=0} 04:44:50.403305 --- ParallelTerminationStrategy: PID 10059 died... 04:44:50.422149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10059): Terminated: ok {rc=0} 04:44:50.508086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 04:44:51.657277 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:51.668772 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:44:51.715734 tst iperf3m4.py: using LAC 38635 04:44:51.835916 tst iperf3m4.py: using RAC 130 04:44:51.956913 tst iperf3m4.py: using CellId 38635 04:44:52.077140 tst iperf3m4.py: using BVCI 38636 04:44:52.187036 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.197834 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.208394 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.219107 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.229594 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.239972 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.250621 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.261008 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:44:52.272136 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:52.387914 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:52.510958 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:52.628067 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:44:52.749331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:44:52.969141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:53.297055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10061): Launched 04:44:53.580172 run iperf3-srv_10.42.42.10(pid=10062): Launched 04:44:53.702575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:44:53.921599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:54.249955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10063): Launched 04:44:54.533149 run iperf3-srv_10.42.42.10(pid=10064): Launched 04:44:54.656615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:44:54.875353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:55.203309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10065): Launched 04:44:55.488712 run iperf3-srv_10.42.42.10(pid=10066): Launched 04:44:55.612622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:44:55.831823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:44:56.159255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10067): Launched 04:44:56.444438 run iperf3-srv_10.42.42.10(pid=10068): Launched 04:44:56.566857 tst iperf3m4.py:8: start network... 04:44:56.785897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:44:57.293091 run create_hlr_db(pid=10069): Launched 04:44:57.418989 bus /gobi_6: Setting Powered False 04:44:58.483142 run create_hlr_db(pid=10069): Terminated: ok {rc=0} 04:44:58.918115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10071): Launched 04:44:59.222704 run osmo-hlr_10.42.42.2(pid=10072): Launched 04:44:59.338113 run osmo-stp_10.42.42.5: Starting osmo-stp 04:44:59.879067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10074): Launched 04:45:00.185778 run osmo-stp_10.42.42.5(pid=10075): Launched 04:45:00.303656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:00.829601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10077): Launched 04:45:00.983248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:01.245789 run patchelf(pid=10078): Launched 04:45:01.452254 run osmo-stp_10.42.42.5(pid=10075): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10075)] 04:45:01.598702 run osmo-stp_10.42.42.5(pid=10075): stdout: | (launched: 2022-12-14_04:45:00.128694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:01.745103 run osmo-stp_10.42.42.5(pid=10075): stderr: | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044500298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:01.891989 run osmo-stp_10.42.42.5(pid=10075): stdout: | (launched: 2022-12-14_04:45:00.128694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:02.030211 run osmo-stp_10.42.42.5(pid=10075): stderr: | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044500298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044500298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044500299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:02.194859 run patchelf(pid=10078): Terminating (SIGINT) 04:45:02.373489 run patchelf(pid=10078): Terminated: ok {rc=0} 04:45:02.496502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10075): Process ended prematurely: osmo-stp_10.42.42.5(pid=10075) [trial-2399↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10075)] [trial-2399↪gprs:nanobts+band-900↪iperf3m4.py:8] 04:45:02.506471 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:45:02.534112 run osmo-hlr_10.42.42.2(pid=10072): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10072)] 04:45:02.581970 run osmo-hlr_10.42.42.2(pid=10072): stdout: | (launched: 2022-12-14_04:44:59.166017) 04:45:02.631492 run osmo-hlr_10.42.42.2(pid=10072): stderr: | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044459338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044459350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044459358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044459358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044459358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:02.681480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10061): Terminating (SIGTERM) 04:45:02.721177 run iperf3-srv_10.42.42.10(pid=10062): Terminating (SIGTERM) 04:45:02.760705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10063): Terminating (SIGTERM) 04:45:02.800065 run iperf3-srv_10.42.42.10(pid=10064): Terminating (SIGTERM) 04:45:02.839325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10065): Terminating (SIGTERM) 04:45:02.878737 run iperf3-srv_10.42.42.10(pid=10066): Terminating (SIGTERM) 04:45:02.918044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10067): Terminating (SIGTERM) 04:45:02.957538 run iperf3-srv_10.42.42.10(pid=10068): Terminating (SIGTERM) 04:45:02.996824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10071): Terminating (SIGTERM) 04:45:03.036397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10074): Terminating (SIGTERM) 04:45:03.075803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10077): Terminating (SIGTERM) 04:45:03.115695 --- ParallelTerminationStrategy: PID 10061 died... 04:45:03.134602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10061): Terminated: ok {rc=0} 04:45:03.179198 --- ParallelTerminationStrategy: PID 10062 died... 04:45:03.197988 run iperf3-srv_10.42.42.10(pid=10062): Terminated {rc=256} 04:45:03.241866 --- ParallelTerminationStrategy: PID 10063 died... 04:45:03.260688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10063): Terminated: ok {rc=0} 04:45:03.304857 --- ParallelTerminationStrategy: PID 10064 died... 04:45:03.324044 run iperf3-srv_10.42.42.10(pid=10064): Terminated {rc=256} 04:45:03.367992 --- ParallelTerminationStrategy: PID 10065 died... 04:45:03.386630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10065): Terminated: ok {rc=0} 04:45:03.431220 --- ParallelTerminationStrategy: PID 10066 died... 04:45:03.450036 run iperf3-srv_10.42.42.10(pid=10066): Terminated {rc=256} 04:45:03.493729 --- ParallelTerminationStrategy: PID 10067 died... 04:45:03.512375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10067): Terminated: ok {rc=0} 04:45:03.556050 --- ParallelTerminationStrategy: PID 10068 died... 04:45:03.574725 run iperf3-srv_10.42.42.10(pid=10068): Terminated {rc=256} 04:45:03.618257 --- ParallelTerminationStrategy: PID 10071 died... 04:45:03.637140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10071): Terminated: ok {rc=0} 04:45:03.681021 --- ParallelTerminationStrategy: PID 10074 died... 04:45:03.699699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10074): Terminated: ok {rc=0} 04:45:03.743458 --- ParallelTerminationStrategy: PID 10077 died... 04:45:03.762249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10077): Terminated: ok {rc=0} 04:45:03.847788 bus /gobi_4: Setting Powered False 04:45:04.946529 bus /gobi_4: Setting Powered False 04:45:06.060764 bus /gobi_1: Setting Powered False 04:45:07.158011 bus /gobi_1: Setting Powered False 04:45:08.272860 bus /gobi_0: Setting Powered False 04:45:09.370518 bus /gobi_0: Setting Powered False 04:45:10.483476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900 ping.py ---------------------------------------------- 04:45:11.585494 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:11.597561 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:45:11.646617 tst ping.py: using LAC 38636 04:45:11.765390 tst ping.py: using RAC 131 04:45:11.883151 tst ping.py: using CellId 38636 04:45:12.002431 tst ping.py: using BVCI 38637 04:45:12.113084 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.123803 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.134533 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.145114 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.156123 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.166689 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.178415 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:12.189666 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:45:12.305523 tst ping.py:19: start network... 04:45:12.504075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:12.967196 run create_hlr_db(pid=10082): Launched 04:45:13.089394 bus /gobi_6: Setting Powered False 04:45:14.149440 run create_hlr_db(pid=10082): Terminated: ok {rc=0} 04:45:14.566055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Launched 04:45:14.865148 run osmo-hlr_10.42.42.2(pid=10085): Launched 04:45:14.977806 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:15.507024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Launched 04:45:15.806070 run osmo-stp_10.42.42.5(pid=10088): Launched 04:45:16.064392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:16.609913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10090): Launched 04:45:16.741847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:17.021671 run patchelf(pid=10091): Launched 04:45:17.206909 run osmo-stp_10.42.42.5(pid=10088): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] 04:45:17.336296 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-14_04:45:15.750444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:17.465083 run osmo-stp_10.42.42.5(pid=10088): stderr: | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044515956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044515956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044515963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044515963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:17.594440 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-14_04:45:15.750444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:17.716498 run osmo-stp_10.42.42.5(pid=10088): stderr: | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044515955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044515956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044515956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044515963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044515963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:17.861702 run patchelf(pid=10091): Terminating (SIGINT) 04:45:18.030148 run patchelf(pid=10091): Terminated: ok {rc=0} 04:45:18.151107 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2399↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] [trial-2399↪gprs:nanobts+band-900↪ping.py:22] 04:45:18.160205 tst ping.py:22: Test FAILED (6.6 sec) 04:45:18.187254 run osmo-hlr_10.42.42.2(pid=10085): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10085)] 04:45:18.235223 run osmo-hlr_10.42.42.2(pid=10085): stdout: | (launched: 2022-12-14_04:45:14.808569) 04:45:18.285090 run osmo-hlr_10.42.42.2(pid=10085): stderr: | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044514982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044514995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044515003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044515003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044515003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:18.334932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminating (SIGTERM) 04:45:18.374571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminating (SIGTERM) 04:45:18.414361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10090): Terminating (SIGTERM) 04:45:18.454841 --- ParallelTerminationStrategy: PID 10084 died... 04:45:18.474227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminated: ok {rc=0} 04:45:18.519072 --- ParallelTerminationStrategy: PID 10087 died... 04:45:18.538162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminated: ok {rc=0} 04:45:18.582655 --- ParallelTerminationStrategy: PID 10090 died... 04:45:18.601627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10090): Terminated: ok {rc=0} 04:45:18.686570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 04:45:19.774592 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:19.786713 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 04:45:19.836882 tst ping_idle_ping.py: using LAC 38637 04:45:19.964355 tst ping_idle_ping.py: using RAC 132 04:45:20.090291 tst ping_idle_ping.py: using CellId 38637 04:45:20.218718 tst ping_idle_ping.py: using BVCI 38638 04:45:20.336576 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.348040 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.359320 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.370516 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.382100 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.393695 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.405490 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 04:45:20.417303 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 04:45:20.533919 tst ping_idle_ping.py:24: start network... 04:45:20.734097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:21.202659 run create_hlr_db(pid=10092): Launched 04:45:21.326083 bus /gobi_6: Setting Powered False 04:45:22.386068 run create_hlr_db(pid=10092): Terminated: ok {rc=0} 04:45:22.804707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Launched 04:45:23.104399 run osmo-hlr_10.42.42.2(pid=10095): Launched 04:45:23.220373 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:23.753289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Launched 04:45:24.054801 run osmo-stp_10.42.42.5(pid=10098): Launched 04:45:24.168431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:24.688127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10100): Launched 04:45:24.803389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:25.056427 run patchelf(pid=10101): Launched 04:45:25.223002 run osmo-stp_10.42.42.5(pid=10098): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] 04:45:25.349703 run osmo-stp_10.42.42.5(pid=10098): stdout: | (launched: 2022-12-14_04:45:23.998655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:25.478413 run osmo-stp_10.42.42.5(pid=10098): stderr: | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044524168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:25.607584 run osmo-stp_10.42.42.5(pid=10098): stdout: | (launched: 2022-12-14_04:45:23.998655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:25.730353 run osmo-stp_10.42.42.5(pid=10098): stderr: | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044524167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044524168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044524168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:25.875318 run patchelf(pid=10101): Terminating (SIGINT) 04:45:26.043230 run patchelf(pid=10101): Terminated: ok {rc=0} 04:45:26.164443 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10098): Process ended prematurely: osmo-stp_10.42.42.5(pid=10098) [trial-2399↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] [trial-2399↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 04:45:26.173507 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:45:26.200588 run osmo-hlr_10.42.42.2(pid=10095): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10095)] 04:45:26.248386 run osmo-hlr_10.42.42.2(pid=10095): stdout: | (launched: 2022-12-14_04:45:23.048297) 04:45:26.297916 run osmo-hlr_10.42.42.2(pid=10095): stderr: | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044523223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044523236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044523245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044523246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044523246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:26.347957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Terminating (SIGTERM) 04:45:26.388047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Terminating (SIGTERM) 04:45:26.427824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10100): Terminating (SIGTERM) 04:45:26.468085 --- ParallelTerminationStrategy: PID 10094 died... 04:45:26.487430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10094): Terminated: ok {rc=0} 04:45:26.531679 --- ParallelTerminationStrategy: PID 10097 died... 04:45:26.550462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10097): Terminated: ok {rc=0} 04:45:26.594529 --- ParallelTerminationStrategy: PID 10100 died... 04:45:26.613341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10100): Terminated: ok {rc=0} 04:45:26.699573 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 04:45:28.008859 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:45:28.016095 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 04:45:28.051171 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 04:45:28.091743 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 04:45:28.181682 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 04:45:28.214607 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 04:45:28.254836 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 04:45:28.853143 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 04:45:28.902805 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:28.913916 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:28.962489 tst cs_paging_gprs_active.py: using LAC 38638 04:45:29.090690 tst cs_paging_gprs_active.py: using RAC 133 04:45:29.221446 tst cs_paging_gprs_active.py: using CellId 38638 04:45:29.342471 tst cs_paging_gprs_active.py: using BVCI 38639 04:45:29.453111 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.464087 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.474938 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.485596 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.496391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.507182 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.517960 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.528432 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:29.539220 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:29.658834 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:29.780522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:45:30.001589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:30.331174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10105): Launched 04:45:30.618552 run iperf3-srv_10.42.42.10(pid=10106): Launched 04:45:30.743622 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:45:30.979519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:31.299448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10107): Launched 04:45:31.587954 run iperf3-srv_10.42.42.10(pid=10108): Launched 04:45:31.722836 tst cs_paging_gprs_active.py:38: start network... 04:45:31.933921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:32.414367 run create_hlr_db(pid=10109): Launched 04:45:32.539824 bus /gobi_6: Setting Powered False 04:45:33.600128 run create_hlr_db(pid=10109): Terminated: ok {rc=0} 04:45:34.047053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10111): Launched 04:45:34.375812 run osmo-hlr_10.42.42.2(pid=10112): Launched 04:45:34.502822 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:35.071699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Launched 04:45:35.403072 run osmo-stp_10.42.42.5(pid=10115): Launched 04:45:35.527608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:36.094518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10117): Launched 04:45:36.221894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:36.498570 run patchelf(pid=10118): Launched 04:45:36.681732 run osmo-stp_10.42.42.5(pid=10115): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] 04:45:36.820003 run osmo-stp_10.42.42.5(pid=10115): stdout: | (launched: 2022-12-14_04:45:35.342257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:36.959954 run osmo-stp_10.42.42.5(pid=10115): stderr: | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044535535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:37.100170 run osmo-stp_10.42.42.5(pid=10115): stdout: | (launched: 2022-12-14_04:45:35.342257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:37.234608 run osmo-stp_10.42.42.5(pid=10115): stderr: | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044535534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044535535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044535535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:37.393666 run patchelf(pid=10118): Terminating (SIGINT) 04:45:37.576207 run patchelf(pid=10118): Terminated: ok {rc=0} 04:45:37.708413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10115): Process ended prematurely: osmo-stp_10.42.42.5(pid=10115) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 04:45:37.718768 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 04:45:37.747337 run osmo-hlr_10.42.42.2(pid=10112): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10112)] 04:45:37.797981 run osmo-hlr_10.42.42.2(pid=10112): stdout: | (launched: 2022-12-14_04:45:34.315450) 04:45:37.850456 run osmo-hlr_10.42.42.2(pid=10112): stderr: | [0;m[1;31m20221214044534512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044534512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044534512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044534512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044534512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044534513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044534525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044534534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:37.902908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10105): Terminating (SIGTERM) 04:45:37.944380 run iperf3-srv_10.42.42.10(pid=10106): Terminating (SIGTERM) 04:45:37.986854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10107): Terminating (SIGTERM) 04:45:38.028893 run iperf3-srv_10.42.42.10(pid=10108): Terminating (SIGTERM) 04:45:38.070843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10111): Terminating (SIGTERM) 04:45:38.113526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Terminating (SIGTERM) 04:45:38.155386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10117): Terminating (SIGTERM) 04:45:38.197970 --- ParallelTerminationStrategy: PID 10105 died... 04:45:38.218464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10105): Terminated: ok {rc=0} 04:45:38.264913 --- ParallelTerminationStrategy: PID 10106 died... 04:45:38.284690 run iperf3-srv_10.42.42.10(pid=10106): Terminated {rc=256} 04:45:38.330735 --- ParallelTerminationStrategy: PID 10107 died... 04:45:38.350831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10107): Terminated: ok {rc=0} 04:45:38.397013 --- ParallelTerminationStrategy: PID 10108 died... 04:45:38.416663 run iperf3-srv_10.42.42.10(pid=10108): Terminated {rc=256} 04:45:38.462636 --- ParallelTerminationStrategy: PID 10111 died... 04:45:38.482382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10111): Terminated: ok {rc=0} 04:45:38.528386 --- ParallelTerminationStrategy: PID 10114 died... 04:45:38.548329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10114): Terminated: ok {rc=0} 04:45:38.594363 --- ParallelTerminationStrategy: PID 10117 died... 04:45:38.614421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10117): Terminated: ok {rc=0} 04:45:38.702897 bus /gobi_0: Setting Powered False 04:45:39.801224 bus /gobi_0: Setting Powered False 04:45:40.912487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 04:45:42.055108 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.066743 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:42.118466 tst iperf3.py: using LAC 38639 04:45:42.240528 tst iperf3.py: using RAC 134 04:45:42.362631 tst iperf3.py: using CellId 38639 04:45:42.484218 tst iperf3.py: using BVCI 38640 04:45:42.596315 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.607566 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.618516 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.629462 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.640321 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.651158 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.662263 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.673403 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:42.684360 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:42.803174 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:43.024605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:43.354161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10119): Launched 04:45:43.639847 run iperf3-srv_10.42.42.10(pid=10120): Launched 04:45:43.764797 tst iperf3.py:8: start network... 04:45:43.985837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:44.496350 run create_hlr_db(pid=10121): Launched 04:45:44.623306 bus /gobi_6: Setting Powered False 04:45:45.687942 run create_hlr_db(pid=10121): Terminated: ok {rc=0} 04:45:46.194239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Launched 04:45:46.537901 run osmo-hlr_10.42.42.2(pid=10124): Launched 04:45:46.786200 run osmo-stp_10.42.42.5: Starting osmo-stp 04:45:47.522653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Launched 04:45:47.829471 run osmo-stp_10.42.42.5(pid=10127): Launched 04:45:47.945561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:45:48.473163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10129): Launched 04:45:48.589448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:45:48.846936 run patchelf(pid=10130): Launched 04:45:49.016405 run osmo-stp_10.42.42.5(pid=10127): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] 04:45:49.145228 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-14_04:45:47.772408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:49.276464 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044547942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:49.406969 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-14_04:45:47.772408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:45:49.531588 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044547941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044547942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044547942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:45:49.679367 run patchelf(pid=10130): Terminating (SIGINT) 04:45:49.851227 run patchelf(pid=10130): Terminated: ok {rc=0} 04:45:49.974152 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 04:45:49.983586 tst iperf3.py:8: Test FAILED (8.0 sec) 04:45:50.010860 run osmo-hlr_10.42.42.2(pid=10124): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10124)] 04:45:50.058503 run osmo-hlr_10.42.42.2(pid=10124): stdout: | (launched: 2022-12-14_04:45:46.475538) 04:45:50.107728 run osmo-hlr_10.42.42.2(pid=10124): stderr: | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044546766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044546782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044546803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044546803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044546803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:45:50.157356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10119): Terminating (SIGTERM) 04:45:50.197061 run iperf3-srv_10.42.42.10(pid=10120): Terminating (SIGTERM) 04:45:50.236506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminating (SIGTERM) 04:45:50.276118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminating (SIGTERM) 04:45:50.315600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10129): Terminating (SIGTERM) 04:45:50.355564 --- ParallelTerminationStrategy: PID 10119 died... 04:45:50.374981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10119): Terminated: ok {rc=0} 04:45:50.418963 --- ParallelTerminationStrategy: PID 10120 died... 04:45:50.437684 run iperf3-srv_10.42.42.10(pid=10120): Terminated {rc=256} 04:45:50.481207 --- ParallelTerminationStrategy: PID 10123 died... 04:45:50.499887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminated: ok {rc=0} 04:45:50.543696 --- ParallelTerminationStrategy: PID 10126 died... 04:45:50.562581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminated: ok {rc=0} 04:45:50.606238 --- ParallelTerminationStrategy: PID 10129 died... 04:45:50.625132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10129): Terminated: ok {rc=0} 04:45:50.708373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 04:45:51.858619 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:51.870811 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:45:51.921610 tst iperf3m4.py: using LAC 38640 04:45:52.053475 tst iperf3m4.py: using RAC 135 04:45:52.176010 tst iperf3m4.py: using CellId 38640 04:45:52.297506 tst iperf3m4.py: using BVCI 38641 04:45:52.410559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.421636 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.432432 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.443315 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.454555 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.465870 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.477252 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.488438 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:45:52.499835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:52.620166 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:52.740300 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:52.860707 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:45:52.980567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:45:53.202349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:53.530798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10133): Launched 04:45:53.817383 run iperf3-srv_10.42.42.10(pid=10134): Launched 04:45:53.942745 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:45:54.163056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:54.493760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Launched 04:45:54.778877 run iperf3-srv_10.42.42.10(pid=10136): Launched 04:45:54.901799 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:45:55.121579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:55.450811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Launched 04:45:55.737426 run iperf3-srv_10.42.42.10(pid=10138): Launched 04:45:55.862375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:45:56.083147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:45:56.402104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10139): Launched 04:45:56.671563 run iperf3-srv_10.42.42.10(pid=10140): Launched 04:45:56.787284 tst iperf3m4.py:8: start network... 04:45:56.990957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:45:57.467108 run create_hlr_db(pid=10141): Launched 04:45:57.593312 bus /gobi_6: Setting Powered False 04:45:58.654771 run create_hlr_db(pid=10141): Terminated: ok {rc=0} 04:45:59.079991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Launched 04:45:59.387050 run osmo-hlr_10.42.42.2(pid=10144): Launched 04:45:59.507497 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:00.032105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Launched 04:46:00.338093 run osmo-stp_10.42.42.5(pid=10147): Launched 04:46:00.454807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:00.985797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10149): Launched 04:46:01.128860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:01.392358 run patchelf(pid=10150): Launched 04:46:01.641967 run osmo-stp_10.42.42.5(pid=10147): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] 04:46:01.786399 run osmo-stp_10.42.42.5(pid=10147): stdout: | (launched: 2022-12-14_04:46:00.281327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:01.921407 run osmo-stp_10.42.42.5(pid=10147): stderr: | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044600450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:02.054554 run osmo-stp_10.42.42.5(pid=10147): stdout: | (launched: 2022-12-14_04:46:00.281327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:02.182255 run osmo-stp_10.42.42.5(pid=10147): stderr: | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044600449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044600450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044600450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:02.332179 run patchelf(pid=10150): Terminating (SIGINT) 04:46:02.502834 run patchelf(pid=10150): Terminated: ok {rc=0} 04:46:02.625583 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10147): Process ended prematurely: osmo-stp_10.42.42.5(pid=10147) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 04:46:02.635472 tst iperf3m4.py:8: Test FAILED (10.8 sec) 04:46:02.663529 run osmo-hlr_10.42.42.2(pid=10144): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10144)] 04:46:02.711826 run osmo-hlr_10.42.42.2(pid=10144): stdout: | (launched: 2022-12-14_04:45:59.330039) 04:46:02.761482 run osmo-hlr_10.42.42.2(pid=10144): stderr: | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044559505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044559517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044559525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044559525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044559525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:02.811417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10133): Terminating (SIGTERM) 04:46:02.851206 run iperf3-srv_10.42.42.10(pid=10134): Terminating (SIGTERM) 04:46:02.890816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Terminating (SIGTERM) 04:46:02.930555 run iperf3-srv_10.42.42.10(pid=10136): Terminating (SIGTERM) 04:46:02.969988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Terminating (SIGTERM) 04:46:03.009527 run iperf3-srv_10.42.42.10(pid=10138): Terminating (SIGTERM) 04:46:03.049052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10139): Terminating (SIGTERM) 04:46:03.088604 run iperf3-srv_10.42.42.10(pid=10140): Terminating (SIGTERM) 04:46:03.127923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Terminating (SIGTERM) 04:46:03.167356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Terminating (SIGTERM) 04:46:03.206734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10149): Terminating (SIGTERM) 04:46:03.246599 --- ParallelTerminationStrategy: PID 10133 died... 04:46:03.266160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10133): Terminated: ok {rc=0} 04:46:03.310294 --- ParallelTerminationStrategy: PID 10134 died... 04:46:03.328885 run iperf3-srv_10.42.42.10(pid=10134): Terminated {rc=256} 04:46:03.373252 --- ParallelTerminationStrategy: PID 10135 died... 04:46:03.391832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Terminated: ok {rc=0} 04:46:03.435625 --- ParallelTerminationStrategy: PID 10136 died... 04:46:03.454343 run iperf3-srv_10.42.42.10(pid=10136): Terminated {rc=256} 04:46:03.498118 --- ParallelTerminationStrategy: PID 10137 died... 04:46:03.516922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Terminated: ok {rc=0} 04:46:03.561457 --- ParallelTerminationStrategy: PID 10138 died... 04:46:03.580319 run iperf3-srv_10.42.42.10(pid=10138): Terminated {rc=256} 04:46:03.624555 --- ParallelTerminationStrategy: PID 10139 died... 04:46:03.643495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10139): Terminated: ok {rc=0} 04:46:03.687665 --- ParallelTerminationStrategy: PID 10140 died... 04:46:03.706566 run iperf3-srv_10.42.42.10(pid=10140): Terminated {rc=256} 04:46:03.750363 --- ParallelTerminationStrategy: PID 10143 died... 04:46:03.769231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10143): Terminated: ok {rc=0} 04:46:03.813390 --- ParallelTerminationStrategy: PID 10146 died... 04:46:03.832491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10146): Terminated: ok {rc=0} 04:46:03.876628 --- ParallelTerminationStrategy: PID 10149 died... 04:46:03.896053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10149): Terminated: ok {rc=0} 04:46:03.982843 bus /gobi_4: Setting Powered False 04:46:05.082605 bus /gobi_4: Setting Powered False 04:46:06.198501 bus /gobi_1: Setting Powered False 04:46:07.298564 bus /gobi_1: Setting Powered False 04:46:08.415226 bus /gobi_0: Setting Powered False 04:46:09.513744 bus /gobi_0: Setting Powered False 04:46:10.631180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 04:46:11.734097 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:11.746369 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:46:11.797836 tst ping.py: using LAC 38641 04:46:11.925671 tst ping.py: using RAC 136 04:46:12.044740 tst ping.py: using CellId 38641 04:46:12.162962 tst ping.py: using BVCI 38642 04:46:12.273640 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.284655 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.295469 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.306288 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.317537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.328742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.340210 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:12.351522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:46:12.470820 tst ping.py:19: start network... 04:46:12.686194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:13.183384 run create_hlr_db(pid=10151): Launched 04:46:13.307100 bus /gobi_6: Setting Powered False 04:46:14.370880 run create_hlr_db(pid=10151): Terminated: ok {rc=0} 04:46:14.799347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Launched 04:46:15.100580 run osmo-hlr_10.42.42.2(pid=10154): Launched 04:46:15.215066 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:15.733390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Launched 04:46:16.058865 run osmo-stp_10.42.42.5(pid=10157): Launched 04:46:16.440108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:17.033877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10159): Launched 04:46:17.162857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:17.422023 run patchelf(pid=10160): Launched 04:46:17.590053 run osmo-stp_10.42.42.5(pid=10157): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] 04:46:17.715984 run osmo-stp_10.42.42.5(pid=10157): stdout: | (launched: 2022-12-14_04:46:15.996551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:17.844274 run osmo-stp_10.42.42.5(pid=10157): stderr: | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044616330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044616330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044616331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044616331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:17.972638 run osmo-stp_10.42.42.5(pid=10157): stdout: | (launched: 2022-12-14_04:46:15.996551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:18.096003 run osmo-stp_10.42.42.5(pid=10157): stderr: | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044616328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044616330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044616330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044616331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044616331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:18.240802 run patchelf(pid=10160): Terminating (SIGINT) 04:46:18.408493 run patchelf(pid=10160): Terminated: ok {rc=0} 04:46:18.528845 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10157): Process ended prematurely: osmo-stp_10.42.42.5(pid=10157) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 04:46:18.537964 tst ping.py:22: Test FAILED (6.8 sec) 04:46:18.564644 run osmo-hlr_10.42.42.2(pid=10154): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10154)] 04:46:18.611858 run osmo-hlr_10.42.42.2(pid=10154): stdout: | (launched: 2022-12-14_04:46:15.044937) 04:46:18.660618 run osmo-hlr_10.42.42.2(pid=10154): stderr: | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044615219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044615231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044615242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044615242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044615242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:18.709798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Terminating (SIGTERM) 04:46:18.748822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Terminating (SIGTERM) 04:46:18.787985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10159): Terminating (SIGTERM) 04:46:18.827307 --- ParallelTerminationStrategy: PID 10153 died... 04:46:18.846391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Terminated: ok {rc=0} 04:46:18.889654 --- ParallelTerminationStrategy: PID 10156 died... 04:46:18.907888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Terminated: ok {rc=0} 04:46:18.951297 --- ParallelTerminationStrategy: PID 10159 died... 04:46:18.969888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10159): Terminated: ok {rc=0} 04:46:19.055101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 04:46:20.143524 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.155635 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 04:46:20.206175 tst ping_idle_ping.py: using LAC 38642 04:46:20.325107 tst ping_idle_ping.py: using RAC 137 04:46:20.441427 tst ping_idle_ping.py: using CellId 38642 04:46:20.572095 tst ping_idle_ping.py: using BVCI 38643 04:46:20.690105 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.701913 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.713432 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.724842 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.736796 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.748568 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.760523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 04:46:20.772325 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 04:46:20.888363 tst ping_idle_ping.py:24: start network... 04:46:21.088524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:21.557214 run create_hlr_db(pid=10161): Launched 04:46:21.680546 bus /gobi_6: Setting Powered False 04:46:22.741561 run create_hlr_db(pid=10161): Terminated: ok {rc=0} 04:46:23.161542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Launched 04:46:23.462572 run osmo-hlr_10.42.42.2(pid=10164): Launched 04:46:23.576486 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:24.091508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Launched 04:46:24.392934 run osmo-stp_10.42.42.5(pid=10167): Launched 04:46:24.506788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:25.026782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Launched 04:46:25.143657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:25.397677 run patchelf(pid=10170): Launched 04:46:25.565553 run osmo-stp_10.42.42.5(pid=10167): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] 04:46:25.691744 run osmo-stp_10.42.42.5(pid=10167): stdout: | (launched: 2022-12-14_04:46:24.336794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:25.820030 run osmo-stp_10.42.42.5(pid=10167): stderr: | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044624508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:25.948695 run osmo-stp_10.42.42.5(pid=10167): stdout: | (launched: 2022-12-14_04:46:24.336794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:26.071479 run osmo-stp_10.42.42.5(pid=10167): stderr: | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044624508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044624508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044624509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:26.216215 run patchelf(pid=10170): Terminating (SIGINT) 04:46:26.383916 run patchelf(pid=10170): Terminated: ok {rc=0} 04:46:26.504252 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10167): Process ended prematurely: osmo-stp_10.42.42.5(pid=10167) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 04:46:26.513275 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:46:26.540233 run osmo-hlr_10.42.42.2(pid=10164): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10164)] 04:46:26.587776 run osmo-hlr_10.42.42.2(pid=10164): stdout: | (launched: 2022-12-14_04:46:23.406453) 04:46:26.637091 run osmo-hlr_10.42.42.2(pid=10164): stderr: | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044623580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044623593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044623601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044623601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044623601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:26.686576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Terminating (SIGTERM) 04:46:26.725981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Terminating (SIGTERM) 04:46:26.765201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Terminating (SIGTERM) 04:46:26.804730 --- ParallelTerminationStrategy: PID 10163 died... 04:46:26.823417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Terminated: ok {rc=0} 04:46:26.867125 --- ParallelTerminationStrategy: PID 10166 died... 04:46:26.885648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Terminated: ok {rc=0} 04:46:26.928873 --- ParallelTerminationStrategy: PID 10169 died... 04:46:26.947589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Terminated: ok {rc=0} 04:46:27.029729 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 04:46:28.342439 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:46:28.351837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 04:46:28.386128 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 04:46:28.426157 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 04:46:28.515064 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 04:46:28.547829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 04:46:28.587075 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 04:46:29.181533 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 04:46:29.231196 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.242229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:29.308225 tst cs_paging_gprs_active.py: using LAC 38643 04:46:29.428941 tst cs_paging_gprs_active.py: using RAC 138 04:46:29.551859 tst cs_paging_gprs_active.py: using CellId 38643 04:46:29.671633 tst cs_paging_gprs_active.py: using BVCI 38644 04:46:29.781724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.792572 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.803408 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.814134 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.825280 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.836863 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.848313 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.859690 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:29.871131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:29.991414 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:30.111654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:46:30.332701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:30.660790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Launched 04:46:30.985663 run iperf3-srv_10.42.42.10(pid=10175): Launched 04:46:31.112560 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:46:31.323504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:31.638537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Launched 04:46:31.928525 run iperf3-srv_10.42.42.10(pid=10177): Launched 04:46:32.091347 tst cs_paging_gprs_active.py:38: start network... 04:46:32.323521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:32.830792 run create_hlr_db(pid=10178): Launched 04:46:32.955905 bus /gobi_6: Setting Powered False 04:46:34.021365 run create_hlr_db(pid=10178): Terminated: ok {rc=0} 04:46:34.458390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Launched 04:46:34.763288 run osmo-hlr_10.42.42.2(pid=10181): Launched 04:46:34.879096 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:35.411546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Launched 04:46:35.718658 run osmo-stp_10.42.42.5(pid=10184): Launched 04:46:35.836668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:36.365548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Launched 04:46:36.482224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:36.740668 run patchelf(pid=10187): Launched 04:46:36.910119 run osmo-stp_10.42.42.5(pid=10184): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] 04:46:37.039181 run osmo-stp_10.42.42.5(pid=10184): stdout: | (launched: 2022-12-14_04:46:35.661439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:37.169965 run osmo-stp_10.42.42.5(pid=10184): stderr: | [0;m[38;5;43m20221214044635829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044635830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044635830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044635830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:37.300571 run osmo-stp_10.42.42.5(pid=10184): stdout: | (launched: 2022-12-14_04:46:35.661439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:37.425503 run osmo-stp_10.42.42.5(pid=10184): stderr: | [0;m[38;5;43m20221214044635829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044635830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044635830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044635830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044635831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:37.573545 run patchelf(pid=10187): Terminating (SIGINT) 04:46:37.744004 run patchelf(pid=10187): Terminated: ok {rc=0} 04:46:37.867025 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10184): Process ended prematurely: osmo-stp_10.42.42.5(pid=10184) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 04:46:37.876481 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 04:46:37.903764 run osmo-hlr_10.42.42.2(pid=10181): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10181)] 04:46:37.951307 run osmo-hlr_10.42.42.2(pid=10181): stdout: | (launched: 2022-12-14_04:46:34.706795) 04:46:38.000673 run osmo-hlr_10.42.42.2(pid=10181): stderr: | [0;m[1;31m20221214044634883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044634884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044634884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044634884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044634884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044634884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044634896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044634904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044634905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044634905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:38.050319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Terminating (SIGTERM) 04:46:38.089743 run iperf3-srv_10.42.42.10(pid=10175): Terminating (SIGTERM) 04:46:38.129202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Terminating (SIGTERM) 04:46:38.169339 run iperf3-srv_10.42.42.10(pid=10177): Terminating (SIGTERM) 04:46:38.208839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Terminating (SIGTERM) 04:46:38.248078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Terminating (SIGTERM) 04:46:38.287543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Terminating (SIGTERM) 04:46:38.327292 --- ParallelTerminationStrategy: PID 10174 died... 04:46:38.346773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10174): Terminated: ok {rc=0} 04:46:38.390721 --- ParallelTerminationStrategy: PID 10175 died... 04:46:38.409496 run iperf3-srv_10.42.42.10(pid=10175): Terminated {rc=256} 04:46:38.453155 --- ParallelTerminationStrategy: PID 10176 died... 04:46:38.471801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10176): Terminated: ok {rc=0} 04:46:38.515646 --- ParallelTerminationStrategy: PID 10177 died... 04:46:38.534482 run iperf3-srv_10.42.42.10(pid=10177): Terminated {rc=256} 04:46:38.578083 --- ParallelTerminationStrategy: PID 10180 died... 04:46:38.596684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10180): Terminated: ok {rc=0} 04:46:38.640342 --- ParallelTerminationStrategy: PID 10183 died... 04:46:38.659211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10183): Terminated: ok {rc=0} 04:46:38.703067 --- ParallelTerminationStrategy: PID 10186 died... 04:46:38.721858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10186): Terminated: ok {rc=0} 04:46:38.807360 bus /gobi_0: Setting Powered False 04:46:39.908147 bus /gobi_0: Setting Powered False 04:46:41.022121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 04:46:42.167121 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.178979 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:42.249220 tst iperf3.py: using LAC 38644 04:46:42.379841 tst iperf3.py: using RAC 139 04:46:42.503404 tst iperf3.py: using CellId 38644 04:46:42.623199 tst iperf3.py: using BVCI 38645 04:46:42.734080 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.745216 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.756148 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.767105 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.777790 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.788488 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.799308 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.809994 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:42.820796 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:42.941633 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:43.162893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:43.492659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Launched 04:46:43.779617 run iperf3-srv_10.42.42.10(pid=10189): Launched 04:46:43.904386 tst iperf3.py:8: start network... 04:46:44.125426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:44.635123 run create_hlr_db(pid=10190): Launched 04:46:44.760414 bus /gobi_6: Setting Powered False 04:46:45.825285 run create_hlr_db(pid=10190): Terminated: ok {rc=0} 04:46:46.350907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Launched 04:46:46.689667 run osmo-hlr_10.42.42.2(pid=10193): Launched 04:46:46.928206 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:47.514174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Launched 04:46:47.820930 run osmo-stp_10.42.42.5(pid=10196): Launched 04:46:47.936818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:46:48.465333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Launched 04:46:48.581878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:46:48.839506 run patchelf(pid=10199): Launched 04:46:49.008678 run osmo-stp_10.42.42.5(pid=10196): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] 04:46:49.138004 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-14_04:46:47.764252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:49.268713 run osmo-stp_10.42.42.5(pid=10196): stderr: | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044647937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:49.399088 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-14_04:46:47.764252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:46:49.523798 run osmo-stp_10.42.42.5(pid=10196): stderr: | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044647936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044647937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044647937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:46:49.671421 run patchelf(pid=10199): Terminating (SIGINT) 04:46:49.842037 run patchelf(pid=10199): Terminated: ok {rc=0} 04:46:49.964880 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 04:46:49.974432 tst iperf3.py:8: Test FAILED (7.8 sec) 04:46:50.001480 run osmo-hlr_10.42.42.2(pid=10193): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10193)] 04:46:50.048769 run osmo-hlr_10.42.42.2(pid=10193): stdout: | (launched: 2022-12-14_04:46:46.619327) 04:46:50.097635 run osmo-hlr_10.42.42.2(pid=10193): stderr: | [0;m[1;31m20221214044646961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044646961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044646961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044646961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044646962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044646962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044646978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044646986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044646986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044646986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:46:50.146973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminating (SIGTERM) 04:46:50.186657 run iperf3-srv_10.42.42.10(pid=10189): Terminating (SIGTERM) 04:46:50.226128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminating (SIGTERM) 04:46:50.266224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminating (SIGTERM) 04:46:50.305875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminating (SIGTERM) 04:46:50.345681 --- ParallelTerminationStrategy: PID 10188 died... 04:46:50.365060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10188): Terminated: ok {rc=0} 04:46:50.409045 --- ParallelTerminationStrategy: PID 10189 died... 04:46:50.427691 run iperf3-srv_10.42.42.10(pid=10189): Terminated {rc=256} 04:46:50.471199 --- ParallelTerminationStrategy: PID 10192 died... 04:46:50.490099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminated: ok {rc=0} 04:46:50.533727 --- ParallelTerminationStrategy: PID 10195 died... 04:46:50.552645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminated: ok {rc=0} 04:46:50.596322 --- ParallelTerminationStrategy: PID 10198 died... 04:46:50.615047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminated: ok {rc=0} 04:46:50.700296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 04:46:51.847942 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:51.859794 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:46:51.928801 tst iperf3m4.py: using LAC 38645 04:46:52.059856 tst iperf3m4.py: using RAC 140 04:46:52.187230 tst iperf3m4.py: using CellId 38645 04:46:52.318882 tst iperf3m4.py: using BVCI 38646 04:46:52.438266 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.450003 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.461484 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.472831 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.484556 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.496385 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.508227 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.519899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:46:52.531827 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:52.652935 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:52.779341 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:52.900605 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:46:53.018402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:46:53.223405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:53.530873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Launched 04:46:53.799574 run iperf3-srv_10.42.42.10(pid=10201): Launched 04:46:53.914231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:46:54.117595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:54.425553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Launched 04:46:54.691517 run iperf3-srv_10.42.42.10(pid=10203): Launched 04:46:54.805837 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:46:55.009657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:55.316031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Launched 04:46:55.581320 run iperf3-srv_10.42.42.10(pid=10205): Launched 04:46:55.695438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:46:55.898646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:46:56.205166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Launched 04:46:56.471649 run iperf3-srv_10.42.42.10(pid=10207): Launched 04:46:56.587491 tst iperf3m4.py:8: start network... 04:46:56.790628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:46:57.263244 run create_hlr_db(pid=10208): Launched 04:46:57.389676 bus /gobi_6: Setting Powered False 04:46:58.450215 run create_hlr_db(pid=10208): Terminated: ok {rc=0} 04:46:58.896675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Launched 04:46:59.226312 run osmo-hlr_10.42.42.2(pid=10211): Launched 04:46:59.354719 run osmo-stp_10.42.42.5: Starting osmo-stp 04:46:59.924246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Launched 04:47:00.254780 run osmo-stp_10.42.42.5(pid=10214): Launched 04:47:00.381813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:00.952150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Launched 04:47:01.134699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:01.434416 run patchelf(pid=10217): Launched 04:47:01.631768 run osmo-stp_10.42.42.5(pid=10214): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] 04:47:01.773545 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-14_04:47:00.192555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:01.917944 run osmo-stp_10.42.42.5(pid=10214): stderr: | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044700383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:02.061655 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-14_04:47:00.192555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:02.199637 run osmo-stp_10.42.42.5(pid=10214): stderr: | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044700383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044700383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044700384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:02.361540 run patchelf(pid=10217): Terminating (SIGINT) 04:47:02.544440 run patchelf(pid=10217): Terminated: ok {rc=0} 04:47:02.676564 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 04:47:02.687087 tst iperf3m4.py:8: Test FAILED (10.9 sec) 04:47:02.716187 run osmo-hlr_10.42.42.2(pid=10211): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10211)] 04:47:02.767951 run osmo-hlr_10.42.42.2(pid=10211): stdout: | (launched: 2022-12-14_04:46:59.165709) 04:47:02.820327 run osmo-hlr_10.42.42.2(pid=10211): stderr: | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044659362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044659375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044659386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044659386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044659386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:02.873361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Terminating (SIGTERM) 04:47:02.915288 run iperf3-srv_10.42.42.10(pid=10201): Terminating (SIGTERM) 04:47:02.958043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminating (SIGTERM) 04:47:03.000421 run iperf3-srv_10.42.42.10(pid=10203): Terminating (SIGTERM) 04:47:03.042648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Terminating (SIGTERM) 04:47:03.085028 run iperf3-srv_10.42.42.10(pid=10205): Terminating (SIGTERM) 04:47:03.127397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Terminating (SIGTERM) 04:47:03.169833 run iperf3-srv_10.42.42.10(pid=10207): Terminating (SIGTERM) 04:47:03.212031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminating (SIGTERM) 04:47:03.254846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminating (SIGTERM) 04:47:03.297378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Terminating (SIGTERM) 04:47:03.340429 --- ParallelTerminationStrategy: PID 10200 died... 04:47:03.361474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10200): Terminated: ok {rc=0} 04:47:03.408768 --- ParallelTerminationStrategy: PID 10201 died... 04:47:03.428896 run iperf3-srv_10.42.42.10(pid=10201): Terminated {rc=256} 04:47:03.475548 --- ParallelTerminationStrategy: PID 10202 died... 04:47:03.495681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10202): Terminated: ok {rc=0} 04:47:03.542663 --- ParallelTerminationStrategy: PID 10203 died... 04:47:03.562790 run iperf3-srv_10.42.42.10(pid=10203): Terminated {rc=256} 04:47:03.608820 --- ParallelTerminationStrategy: PID 10204 died... 04:47:03.629112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10204): Terminated: ok {rc=0} 04:47:03.675710 --- ParallelTerminationStrategy: PID 10205 died... 04:47:03.695702 run iperf3-srv_10.42.42.10(pid=10205): Terminated {rc=256} 04:47:03.741675 --- ParallelTerminationStrategy: PID 10206 died... 04:47:03.761642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10206): Terminated: ok {rc=0} 04:47:03.808460 --- ParallelTerminationStrategy: PID 10207 died... 04:47:03.828476 run iperf3-srv_10.42.42.10(pid=10207): Terminated {rc=256} 04:47:03.874720 --- ParallelTerminationStrategy: PID 10210 died... 04:47:03.894699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminated: ok {rc=0} 04:47:03.940905 --- ParallelTerminationStrategy: PID 10213 died... 04:47:03.961547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminated: ok {rc=0} 04:47:04.008386 --- ParallelTerminationStrategy: PID 10216 died... 04:47:04.028740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10216): Terminated: ok {rc=0} 04:47:04.119363 bus /gobi_4: Setting Powered False 04:47:05.219479 bus /gobi_4: Setting Powered False 04:47:06.337499 bus /gobi_1: Setting Powered False 04:47:07.437418 bus /gobi_1: Setting Powered False 04:47:08.554803 bus /gobi_0: Setting Powered False 04:47:09.654834 bus /gobi_0: Setting Powered False 04:47:10.773375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 04:47:11.875975 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:11.888272 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:47:11.958615 tst ping.py: using LAC 38646 04:47:12.090448 tst ping.py: using RAC 141 04:47:12.216129 tst ping.py: using CellId 38646 04:47:12.342328 tst ping.py: using BVCI 38647 04:47:12.461234 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.472779 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.484132 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.495567 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.507131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.518770 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.530619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:12.542232 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:47:12.658553 tst ping.py:19: start network... 04:47:12.876468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:13.375857 run create_hlr_db(pid=10221): Launched 04:47:13.499491 bus /gobi_6: Setting Powered False 04:47:14.563010 run create_hlr_db(pid=10221): Terminated: ok {rc=0} 04:47:14.992510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Launched 04:47:15.294006 run osmo-hlr_10.42.42.2(pid=10224): Launched 04:47:15.408200 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:15.934122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Launched 04:47:16.283494 run osmo-stp_10.42.42.5(pid=10227): Launched 04:47:16.519125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:17.115564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Launched 04:47:17.243961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:17.499426 run patchelf(pid=10230): Launched 04:47:17.668162 run osmo-stp_10.42.42.5(pid=10227): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] 04:47:17.795150 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-14_04:47:16.219551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:17.924125 run osmo-stp_10.42.42.5(pid=10227): stderr: | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044716514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:18.052812 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-14_04:47:16.219551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:18.175857 run osmo-stp_10.42.42.5(pid=10227): stderr: | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044716513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044716514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044716514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:18.321542 run patchelf(pid=10230): Terminating (SIGINT) 04:47:18.490100 run patchelf(pid=10230): Terminated: ok {rc=0} 04:47:18.611228 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 04:47:18.620121 tst ping.py:22: Test FAILED (6.7 sec) 04:47:18.647093 run osmo-hlr_10.42.42.2(pid=10224): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10224)] 04:47:18.694848 run osmo-hlr_10.42.42.2(pid=10224): stdout: | (launched: 2022-12-14_04:47:15.238071) 04:47:18.743676 run osmo-hlr_10.42.42.2(pid=10224): stderr: | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044715411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044715424 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044715434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044715434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044715434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:18.792939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminating (SIGTERM) 04:47:18.832092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminating (SIGTERM) 04:47:18.871267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Terminating (SIGTERM) 04:47:18.910551 --- ParallelTerminationStrategy: PID 10223 died... 04:47:18.929672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminated: ok {rc=0} 04:47:18.973273 --- ParallelTerminationStrategy: PID 10226 died... 04:47:18.991841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminated: ok {rc=0} 04:47:19.035466 --- ParallelTerminationStrategy: PID 10229 died... 04:47:19.054208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10229): Terminated: ok {rc=0} 04:47:19.139888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 04:47:20.227622 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.239370 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 04:47:20.311595 tst ping_idle_ping.py: using LAC 38647 04:47:20.428734 tst ping_idle_ping.py: using RAC 142 04:47:20.545648 tst ping_idle_ping.py: using CellId 38647 04:47:20.661441 tst ping_idle_ping.py: using BVCI 38648 04:47:20.770357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.781442 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.792161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.802931 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.813705 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.824466 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.835341 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 04:47:20.846132 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 04:47:20.966890 tst ping_idle_ping.py:24: start network... 04:47:21.184253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:21.688284 run create_hlr_db(pid=10231): Launched 04:47:21.813994 bus /gobi_6: Setting Powered False 04:47:22.879259 run create_hlr_db(pid=10231): Terminated: ok {rc=0} 04:47:23.311871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Launched 04:47:23.615901 run osmo-hlr_10.42.42.2(pid=10234): Launched 04:47:23.731125 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:24.265270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Launched 04:47:24.566421 run osmo-stp_10.42.42.5(pid=10237): Launched 04:47:24.682600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:25.201590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Launched 04:47:25.316940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:25.571374 run patchelf(pid=10240): Launched 04:47:25.739770 run osmo-stp_10.42.42.5(pid=10237): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] 04:47:25.866358 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-14_04:47:24.509456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:25.995349 run osmo-stp_10.42.42.5(pid=10237): stderr: | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044724680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:26.124279 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-14_04:47:24.509456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:26.246849 run osmo-stp_10.42.42.5(pid=10237): stderr: | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044724680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044724680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044724681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:26.392355 run patchelf(pid=10240): Terminating (SIGINT) 04:47:26.561448 run patchelf(pid=10240): Terminated: ok {rc=0} 04:47:26.682497 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 04:47:26.691432 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 04:47:26.718305 run osmo-hlr_10.42.42.2(pid=10234): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10234)] 04:47:26.765618 run osmo-hlr_10.42.42.2(pid=10234): stdout: | (launched: 2022-12-14_04:47:23.559842) 04:47:26.814512 run osmo-hlr_10.42.42.2(pid=10234): stderr: | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044723734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044723746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044723754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044723754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044723754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:26.863952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminating (SIGTERM) 04:47:26.903453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminating (SIGTERM) 04:47:26.942959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminating (SIGTERM) 04:47:26.982758 --- ParallelTerminationStrategy: PID 10233 died... 04:47:27.001846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminated: ok {rc=0} 04:47:27.045484 --- ParallelTerminationStrategy: PID 10236 died... 04:47:27.064155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminated: ok {rc=0} 04:47:27.107570 --- ParallelTerminationStrategy: PID 10239 died... 04:47:27.126607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminated: ok {rc=0} 04:47:27.209238 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 04:47:28.522345 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:47:28.530808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 04:47:28.564811 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 04:47:28.604315 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 04:47:28.693498 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 04:47:28.726054 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 04:47:28.765320 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 04:47:29.370457 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 04:47:29.422684 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:29.434557 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:29.484089 tst cs_paging_gprs_active.py: using LAC 38648 04:47:29.604507 tst cs_paging_gprs_active.py: using RAC 143 04:47:29.727064 tst cs_paging_gprs_active.py: using CellId 38648 04:47:29.845886 tst cs_paging_gprs_active.py: using BVCI 38649 04:47:29.955964 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:29.967566 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:29.978888 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:29.990150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.001871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.013631 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.025287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.036763 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:30.048519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:30.169646 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:30.289251 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 04:47:30.507360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:30.833659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10244): Launched 04:47:31.141172 run iperf3-srv_10.42.42.10(pid=10245): Launched 04:47:31.281231 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 04:47:31.508083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:31.842878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10246): Launched 04:47:32.124838 run iperf3-srv_10.42.42.10(pid=10247): Launched 04:47:32.247637 tst cs_paging_gprs_active.py:38: start network... 04:47:32.450046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:32.921498 run create_hlr_db(pid=10248): Launched 04:47:33.045465 bus /gobi_6: Setting Powered False 04:47:34.108789 run create_hlr_db(pid=10248): Terminated: ok {rc=0} 04:47:34.559488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10250): Launched 04:47:34.885911 run osmo-hlr_10.42.42.2(pid=10251): Launched 04:47:35.010457 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:35.569534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10253): Launched 04:47:35.894662 run osmo-stp_10.42.42.5(pid=10254): Launched 04:47:36.019072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:36.578935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10256): Launched 04:47:36.704354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:36.977571 run patchelf(pid=10257): Launched 04:47:37.157895 run osmo-stp_10.42.42.5(pid=10254): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10254)] 04:47:37.295777 run osmo-stp_10.42.42.5(pid=10254): stdout: | (launched: 2022-12-14_04:47:35.835076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:37.435270 run osmo-stp_10.42.42.5(pid=10254): stderr: | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044736025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:37.574905 run osmo-stp_10.42.42.5(pid=10254): stdout: | (launched: 2022-12-14_04:47:35.835076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:37.708340 run osmo-stp_10.42.42.5(pid=10254): stderr: | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044736025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044736025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044736026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:37.866419 run patchelf(pid=10257): Terminating (SIGINT) 04:47:38.048060 run patchelf(pid=10257): Terminated: ok {rc=0} 04:47:38.179557 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10254): Process ended prematurely: osmo-stp_10.42.42.5(pid=10254) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10254)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 04:47:38.189992 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 04:47:38.218434 run osmo-hlr_10.42.42.2(pid=10251): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10251)] 04:47:38.269679 run osmo-hlr_10.42.42.2(pid=10251): stdout: | (launched: 2022-12-14_04:47:34.826429) 04:47:38.322092 run osmo-hlr_10.42.42.2(pid=10251): stderr: | [0;m[1;31m20221214044735022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044735022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044735022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044735022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044735022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044735023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044735035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044735043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044735043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044735044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:38.374296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10244): Terminating (SIGTERM) 04:47:38.416012 run iperf3-srv_10.42.42.10(pid=10245): Terminating (SIGTERM) 04:47:38.457820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10246): Terminating (SIGTERM) 04:47:38.500222 run iperf3-srv_10.42.42.10(pid=10247): Terminating (SIGTERM) 04:47:38.541866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10250): Terminating (SIGTERM) 04:47:38.584584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10253): Terminating (SIGTERM) 04:47:38.626556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10256): Terminating (SIGTERM) 04:47:38.668656 --- ParallelTerminationStrategy: PID 10244 died... 04:47:38.689147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10244): Terminated: ok {rc=0} 04:47:38.735326 --- ParallelTerminationStrategy: PID 10245 died... 04:47:38.755150 run iperf3-srv_10.42.42.10(pid=10245): Terminated {rc=256} 04:47:38.801078 --- ParallelTerminationStrategy: PID 10246 died... 04:47:38.820665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10246): Terminated: ok {rc=0} 04:47:38.866609 --- ParallelTerminationStrategy: PID 10247 died... 04:47:38.886404 run iperf3-srv_10.42.42.10(pid=10247): Terminated {rc=256} 04:47:38.932477 --- ParallelTerminationStrategy: PID 10250 died... 04:47:38.952148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10250): Terminated: ok {rc=0} 04:47:38.997866 --- ParallelTerminationStrategy: PID 10253 died... 04:47:39.017681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10253): Terminated: ok {rc=0} 04:47:39.063229 --- ParallelTerminationStrategy: PID 10256 died... 04:47:39.083115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10256): Terminated: ok {rc=0} 04:47:39.171065 bus /gobi_0: Setting Powered False 04:47:40.270004 bus /gobi_0: Setting Powered False 04:47:41.385327 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 04:47:42.533623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:42.546066 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:42.596818 tst iperf3.py: using LAC 38649 04:47:42.723900 tst iperf3.py: using RAC 144 04:47:42.851853 tst iperf3.py: using CellId 38649 04:47:42.978373 tst iperf3.py: using BVCI 38650 04:47:43.096226 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.108101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.119687 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.131344 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.143310 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.155201 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.167249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.179104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:43.191251 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:43.310806 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 04:47:43.512409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:43.814892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10258): Launched 04:47:44.079657 run iperf3-srv_10.42.42.10(pid=10259): Launched 04:47:44.192878 tst iperf3.py:8: start network... 04:47:44.393646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:44.862331 run create_hlr_db(pid=10260): Launched 04:47:44.986036 bus /gobi_6: Setting Powered False 04:47:46.061257 run create_hlr_db(pid=10260): Terminated: ok {rc=0} 04:47:46.530315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Launched 04:47:46.861667 run osmo-hlr_10.42.42.2(pid=10263): Launched 04:47:47.090981 run osmo-stp_10.42.42.5: Starting osmo-stp 04:47:47.711168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Launched 04:47:48.037098 run osmo-stp_10.42.42.5(pid=10266): Launched 04:47:48.162503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:47:48.721666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Launched 04:47:48.848143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:47:49.124252 run patchelf(pid=10269): Launched 04:47:49.304695 run osmo-stp_10.42.42.5(pid=10266): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] 04:47:49.441875 run osmo-stp_10.42.42.5(pid=10266): stdout: | (launched: 2022-12-14_04:47:47.977483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:49.580537 run osmo-stp_10.42.42.5(pid=10266): stderr: | [0;m[38;5;43m20221214044748167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044748167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044748168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044748168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:49.719377 run osmo-stp_10.42.42.5(pid=10266): stdout: | (launched: 2022-12-14_04:47:47.977483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:47:49.852652 run osmo-stp_10.42.42.5(pid=10266): stderr: | [0;m[38;5;43m20221214044748167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044748167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044748168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044748168 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044748169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:47:50.010374 run patchelf(pid=10269): Terminating (SIGINT) 04:47:50.191495 run patchelf(pid=10269): Terminated: ok {rc=0} 04:47:50.322800 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10266): Process ended prematurely: osmo-stp_10.42.42.5(pid=10266) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 04:47:50.333118 tst iperf3.py:8: Test FAILED (7.8 sec) 04:47:50.361595 run osmo-hlr_10.42.42.2(pid=10263): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10263)] 04:47:50.412688 run osmo-hlr_10.42.42.2(pid=10263): stdout: | (launched: 2022-12-14_04:47:46.793843) 04:47:50.465214 run osmo-hlr_10.42.42.2(pid=10263): stderr: | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044747130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044747144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044747152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044747152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044747152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:47:50.518060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10258): Terminating (SIGTERM) 04:47:50.559656 run iperf3-srv_10.42.42.10(pid=10259): Terminating (SIGTERM) 04:47:50.602002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Terminating (SIGTERM) 04:47:50.643973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Terminating (SIGTERM) 04:47:50.685937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Terminating (SIGTERM) 04:47:50.727924 --- ParallelTerminationStrategy: PID 10258 died... 04:47:50.748258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10258): Terminated: ok {rc=0} 04:47:50.794395 --- ParallelTerminationStrategy: PID 10259 died... 04:47:50.814001 run iperf3-srv_10.42.42.10(pid=10259): Terminated {rc=256} 04:47:50.859783 --- ParallelTerminationStrategy: PID 10262 died... 04:47:50.879560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Terminated: ok {rc=0} 04:47:50.925580 --- ParallelTerminationStrategy: PID 10265 died... 04:47:50.945278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Terminated: ok {rc=0} 04:47:50.991360 --- ParallelTerminationStrategy: PID 10268 died... 04:47:51.011091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Terminated: ok {rc=0} 04:47:51.099243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 04:47:52.249336 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.262390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:47:52.317368 tst iperf3m4.py: using LAC 38650 04:47:52.447535 tst iperf3m4.py: using RAC 145 04:47:52.574326 tst iperf3m4.py: using CellId 38650 04:47:52.700011 tst iperf3m4.py: using BVCI 38651 04:47:52.818699 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.830689 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.842453 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.854219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.866667 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.879117 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.891665 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.904081 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:47:52.916695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.041838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.165348 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.281300 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:47:53.400683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 04:47:53.619812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:53.944410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Launched 04:47:54.225540 run iperf3-srv_10.42.42.10(pid=10271): Launched 04:47:54.349561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 04:47:54.567992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:54.894949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Launched 04:47:55.176491 run iperf3-srv_10.42.42.10(pid=10273): Launched 04:47:55.298498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 04:47:55.516150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:55.841500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10274): Launched 04:47:56.123658 run iperf3-srv_10.42.42.10(pid=10275): Launched 04:47:56.245273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 04:47:56.462996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 04:47:56.787854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10276): Launched 04:47:57.069404 run iperf3-srv_10.42.42.10(pid=10277): Launched 04:47:57.193277 tst iperf3m4.py:8: start network... 04:47:57.412112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:47:57.916055 run create_hlr_db(pid=10278): Launched 04:47:58.041834 bus /gobi_6: Setting Powered False 04:47:59.105943 run create_hlr_db(pid=10278): Terminated: ok {rc=0} 04:47:59.557011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10280): Launched 04:47:59.880564 run osmo-hlr_10.42.42.2(pid=10281): Launched 04:48:00.003797 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:00.565229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10283): Launched 04:48:00.896072 run osmo-stp_10.42.42.5(pid=10284): Launched 04:48:01.136703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:01.816220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10286): Launched 04:48:01.953930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:02.235091 run patchelf(pid=10287): Launched 04:48:02.412680 run osmo-stp_10.42.42.5(pid=10284): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10284)] 04:48:02.541883 run osmo-stp_10.42.42.5(pid=10284): stdout: | (launched: 2022-12-14_04:48:00.831527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:02.672852 run osmo-stp_10.42.42.5(pid=10284): stderr: | [0;m[38;5;43m20221214044801159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044801163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:02.803345 run osmo-stp_10.42.42.5(pid=10284): stdout: | (launched: 2022-12-14_04:48:00.831527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:02.929296 run osmo-stp_10.42.42.5(pid=10284): stderr: | [0;m[38;5;43m20221214044801159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044801161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044801163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044801165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:03.077339 run patchelf(pid=10287): Terminating (SIGINT) 04:48:03.248208 run patchelf(pid=10287): Terminated: ok {rc=0} 04:48:03.371728 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10284): Process ended prematurely: osmo-stp_10.42.42.5(pid=10284) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10284)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 04:48:03.381537 tst iperf3m4.py:8: Test FAILED (11.2 sec) 04:48:03.409296 run osmo-hlr_10.42.42.2(pid=10281): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10281)] 04:48:03.457879 run osmo-hlr_10.42.42.2(pid=10281): stdout: | (launched: 2022-12-14_04:47:59.820489) 04:48:03.507656 run osmo-hlr_10.42.42.2(pid=10281): stderr: | [0;m[1;31m20221214044800013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044800013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044800014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044800014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044800014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044800014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044800026 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044800034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044800034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044800034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:03.558124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Terminating (SIGTERM) 04:48:03.598218 run iperf3-srv_10.42.42.10(pid=10271): Terminating (SIGTERM) 04:48:03.637880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Terminating (SIGTERM) 04:48:03.677858 run iperf3-srv_10.42.42.10(pid=10273): Terminating (SIGTERM) 04:48:03.717667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10274): Terminating (SIGTERM) 04:48:03.757614 run iperf3-srv_10.42.42.10(pid=10275): Terminating (SIGTERM) 04:48:03.797598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10276): Terminating (SIGTERM) 04:48:03.837712 run iperf3-srv_10.42.42.10(pid=10277): Terminating (SIGTERM) 04:48:03.877545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10280): Terminating (SIGTERM) 04:48:03.917609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10283): Terminating (SIGTERM) 04:48:03.957722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10286): Terminating (SIGTERM) 04:48:03.998213 --- ParallelTerminationStrategy: PID 10270 died... 04:48:04.017417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Terminated: ok {rc=0} 04:48:04.062084 --- ParallelTerminationStrategy: PID 10271 died... 04:48:04.080777 run iperf3-srv_10.42.42.10(pid=10271): Terminated {rc=256} 04:48:04.125302 --- ParallelTerminationStrategy: PID 10272 died... 04:48:04.144379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Terminated: ok {rc=0} 04:48:04.188626 --- ParallelTerminationStrategy: PID 10273 died... 04:48:04.207647 run iperf3-srv_10.42.42.10(pid=10273): Terminated {rc=256} 04:48:04.251927 --- ParallelTerminationStrategy: PID 10274 died... 04:48:04.270885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10274): Terminated: ok {rc=0} 04:48:04.315107 --- ParallelTerminationStrategy: PID 10275 died... 04:48:04.334192 run iperf3-srv_10.42.42.10(pid=10275): Terminated {rc=256} 04:48:04.378632 --- ParallelTerminationStrategy: PID 10276 died... 04:48:04.397752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10276): Terminated: ok {rc=0} 04:48:04.442035 --- ParallelTerminationStrategy: PID 10277 died... 04:48:04.461075 run iperf3-srv_10.42.42.10(pid=10277): Terminated {rc=256} 04:48:04.505430 --- ParallelTerminationStrategy: PID 10280 died... 04:48:04.524134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10280): Terminated: ok {rc=0} 04:48:04.568176 --- ParallelTerminationStrategy: PID 10283 died... 04:48:04.587138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10283): Terminated: ok {rc=0} 04:48:04.631332 --- ParallelTerminationStrategy: PID 10286 died... 04:48:04.650318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10286): Terminated: ok {rc=0} 04:48:04.736580 bus /gobi_4: Setting Powered False 04:48:05.835002 bus /gobi_4: Setting Powered False 04:48:06.949513 bus /gobi_1: Setting Powered False 04:48:08.048155 bus /gobi_1: Setting Powered False 04:48:09.163203 bus /gobi_0: Setting Powered False 04:48:10.261483 bus /gobi_0: Setting Powered False 04:48:11.374531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 04:48:12.476024 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:12.488618 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:48:12.540094 tst ping.py: using LAC 38651 04:48:12.667236 tst ping.py: using RAC 146 04:48:12.792312 tst ping.py: using CellId 38651 04:48:12.910917 tst ping.py: using BVCI 38652 04:48:13.018284 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.030033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.041546 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.052893 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.064353 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.075691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.087036 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:13.098388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:48:13.217833 tst ping.py:19: start network... 04:48:13.417190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:13.879470 run create_hlr_db(pid=10288): Launched 04:48:14.001305 bus /gobi_6: Setting Powered False 04:48:15.061533 run create_hlr_db(pid=10288): Terminated: ok {rc=0} 04:48:15.500636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10290): Launched 04:48:15.820877 run osmo-hlr_10.42.42.2(pid=10291): Launched 04:48:16.003220 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:16.673749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10293): Launched 04:48:16.982054 run osmo-stp_10.42.42.5(pid=10294): Launched 04:48:17.258930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:17.811539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10296): Launched 04:48:17.933589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:18.204271 run patchelf(pid=10297): Launched 04:48:18.383854 run osmo-stp_10.42.42.5(pid=10294): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10294)] 04:48:18.519319 run osmo-stp_10.42.42.5(pid=10294): stdout: | (launched: 2022-12-14_04:48:16.924328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:18.656931 run osmo-stp_10.42.42.5(pid=10294): stderr: | [0;m[38;5;43m20221214044817098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044817098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044817099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044817100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:18.794718 run osmo-stp_10.42.42.5(pid=10294): stdout: | (launched: 2022-12-14_04:48:16.924328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:18.925851 run osmo-stp_10.42.42.5(pid=10294): stderr: | [0;m[38;5;43m20221214044817098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044817098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044817099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044817100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044817101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:19.081755 run patchelf(pid=10297): Terminating (SIGINT) 04:48:19.260314 run patchelf(pid=10297): Terminated: ok {rc=0} 04:48:19.390154 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10294): Process ended prematurely: osmo-stp_10.42.42.5(pid=10294) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10294)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 04:48:19.399725 tst ping.py:22: Test FAILED (6.9 sec) 04:48:19.428098 run osmo-hlr_10.42.42.2(pid=10291): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10291)] 04:48:19.479094 run osmo-hlr_10.42.42.2(pid=10291): stdout: | (launched: 2022-12-14_04:48:15.761355) 04:48:19.531697 run osmo-hlr_10.42.42.2(pid=10291): stderr: | [0;m[1;31m20221214044816103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044816103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044816103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044816103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044816104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044816104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044816125 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044816133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044816133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044816133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:19.584564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10290): Terminating (SIGTERM) 04:48:19.626020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10293): Terminating (SIGTERM) 04:48:19.668540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10296): Terminating (SIGTERM) 04:48:19.711079 --- ParallelTerminationStrategy: PID 10290 died... 04:48:19.731550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10290): Terminated: ok {rc=0} 04:48:19.778282 --- ParallelTerminationStrategy: PID 10293 died... 04:48:19.798183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10293): Terminated: ok {rc=0} 04:48:19.844657 --- ParallelTerminationStrategy: PID 10296 died... 04:48:19.864722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10296): Terminated: ok {rc=0} 04:48:19.953682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 04:48:21.040776 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.053845 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 04:48:21.106885 tst ping_idle_ping.py: using LAC 38652 04:48:21.234459 tst ping_idle_ping.py: using RAC 147 04:48:21.360318 tst ping_idle_ping.py: using CellId 38652 04:48:21.487187 tst ping_idle_ping.py: using BVCI 38653 04:48:21.604883 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.616932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.628783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.640494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.652456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.664507 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.676800 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 04:48:21.688780 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 04:48:21.806182 tst ping_idle_ping.py:24: start network... 04:48:22.022629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:22.521705 run create_hlr_db(pid=10298): Launched 04:48:22.645503 bus /gobi_6: Setting Powered False 04:48:23.709241 run create_hlr_db(pid=10298): Terminated: ok {rc=0} 04:48:24.138909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Launched 04:48:24.440344 run osmo-hlr_10.42.42.2(pid=10301): Launched 04:48:24.554650 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:25.071621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Launched 04:48:25.370347 run osmo-stp_10.42.42.5(pid=10304): Launched 04:48:25.483778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:26.000319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Launched 04:48:26.115244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:26.369398 run patchelf(pid=10307): Launched 04:48:26.536379 run osmo-stp_10.42.42.5(pid=10304): ERR: Terminated: ERROR {rc=1} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] 04:48:26.663776 run osmo-stp_10.42.42.5(pid=10304): stdout: | (launched: 2022-12-14_04:48:25.314578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:26.793242 run osmo-stp_10.42.42.5(pid=10304): stderr: | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044825486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:26.922781 run osmo-stp_10.42.42.5(pid=10304): stdout: | (launched: 2022-12-14_04:48:25.314578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:27.046887 run osmo-stp_10.42.42.5(pid=10304): stderr: | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044825485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044825486 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:27.192784 run patchelf(pid=10307): Terminating (SIGINT) 04:48:27.360849 run patchelf(pid=10307): Terminated: ok {rc=0} 04:48:27.482083 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10304): Process ended prematurely: osmo-stp_10.42.42.5(pid=10304) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 04:48:27.491205 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 04:48:27.517957 run osmo-hlr_10.42.42.2(pid=10301): ERR: Terminated: ERROR {rc=237} [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10301)] 04:48:27.565580 run osmo-hlr_10.42.42.2(pid=10301): stdout: | (launched: 2022-12-14_04:48:24.384480) 04:48:27.614820 run osmo-hlr_10.42.42.2(pid=10301): stderr: | [0;m[1;31m20221214044824557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044824557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044824558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044824558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044824558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044824558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044824573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044824583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044824584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:27.664618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Terminating (SIGTERM) 04:48:27.704282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Terminating (SIGTERM) 04:48:27.743923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Terminating (SIGTERM) 04:48:27.783772 --- ParallelTerminationStrategy: PID 10300 died... 04:48:27.803078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Terminated: ok {rc=0} 04:48:27.846823 --- ParallelTerminationStrategy: PID 10303 died... 04:48:27.865737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Terminated: ok {rc=0} 04:48:27.909580 --- ParallelTerminationStrategy: PID 10306 died... 04:48:27.928400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Terminated: ok {rc=0} 04:48:28.014780 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 04:48:29.331405 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:29.339311 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 04:48:29.371588 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 04:48:29.406371 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 04:48:29.459637 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 04:48:29.492698 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 04:48:29.528268 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 04:48:30.085979 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2399 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 04:48:30.091015 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.102630 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 04:48:30.169330 tst switch_tch_pdch.py: using LAC 38653 04:48:30.285940 tst switch_tch_pdch.py: using RAC 148 04:48:30.405042 tst switch_tch_pdch.py: using CellId 38653 04:48:30.522682 tst switch_tch_pdch.py: using BVCI 38654 04:48:30.632327 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.643929 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.655333 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.666769 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.678156 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.689438 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.700907 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 04:48:30.712388 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:48:30.834871 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 04:48:30.995829 tst switch_tch_pdch.py:51: start network... 04:48:31.222602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:31.735343 run create_hlr_db(pid=10313): Launched 04:48:31.900569 bus /gobi_6: Setting Powered False 04:48:32.963992 run create_hlr_db(pid=10313): Terminated: ok {rc=0} 04:48:33.396184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Launched 04:48:33.694587 run osmo-hlr_10.42.42.2(pid=10316): Launched 04:48:33.808196 run osmo-stp_10.42.42.5: Starting osmo-stp 04:48:34.322734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Launched 04:48:34.620800 run osmo-stp_10.42.42.5(pid=10319): Launched 04:48:34.734156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 04:48:35.250962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Launched 04:48:35.366607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 04:48:35.618858 run patchelf(pid=10322): Launched 04:48:35.786317 run osmo-stp_10.42.42.5(pid=10319): ERR: Terminated: ERROR {rc=1} [trial-2399↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] 04:48:35.912447 run osmo-stp_10.42.42.5(pid=10319): stdout: | (launched: 2022-12-14_04:48:34.565222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:36.040618 run osmo-stp_10.42.42.5(pid=10319): stderr: | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044834735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:36.169131 run osmo-stp_10.42.42.5(pid=10319): stdout: | (launched: 2022-12-14_04:48:34.565222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:48:36.291206 run osmo-stp_10.42.42.5(pid=10319): stderr: | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044834734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044834735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044834735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:48:36.435554 run patchelf(pid=10322): Terminating (SIGINT) 04:48:36.603101 run patchelf(pid=10322): Terminated: ok {rc=0} 04:48:36.723230 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10319): Process ended prematurely: osmo-stp_10.42.42.5(pid=10319) [trial-2399↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] [trial-2399↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 04:48:36.732118 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 04:48:36.758603 run osmo-hlr_10.42.42.2(pid=10316): ERR: Terminated: ERROR {rc=237} [trial-2399↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10316)] 04:48:36.806383 run osmo-hlr_10.42.42.2(pid=10316): stdout: | (launched: 2022-12-14_04:48:33.639259) 04:48:36.855750 run osmo-hlr_10.42.42.2(pid=10316): stderr: | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044833813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044833825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044833834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044833834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044833834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:48:36.905538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Terminating (SIGTERM) 04:48:36.945244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Terminating (SIGTERM) 04:48:36.984795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Terminating (SIGTERM) 04:48:37.024366 --- ParallelTerminationStrategy: PID 10315 died... 04:48:37.043692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10315): Terminated: ok {rc=0} 04:48:37.087447 --- ParallelTerminationStrategy: PID 10318 died... 04:48:37.106407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10318): Terminated: ok {rc=0} 04:48:37.150298 --- ParallelTerminationStrategy: PID 10321 died... 04:48:37.168775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10321): Terminated: ok {rc=0} 04:48:37.253867 bus /gobi_0: Setting Powered False 04:48:38.354112 bus /gobi_0: Setting Powered False 04:48:39.468942 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2399 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 nitb_smpp --------------------------------------------------------------------- 04:48:40.730795 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:40.733816 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 04:48:40.755000 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 04:48:40.762175 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 04:48:40.797180 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 04:48:40.818994 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 04:48:40.825924 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 04:48:41.347604 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2399 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:48:41.353068 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:41.371844 tst esme_connect_policy_acceptall.py: using MSISDN 8508 04:48:41.514011 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:42.121868 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10326): Launched 04:48:42.449185 run osmo-nitb_10.42.42.2(pid=10327): Launched 04:48:42.628822 run osmo-nitb_10.42.42.2(pid=10327): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10327)] 04:48:42.775196 run osmo-nitb_10.42.42.2(pid=10327): stdout: | (launched: 2022-12-14_04:48:42.389154) 04:48:42.922888 run osmo-nitb_10.42.42.2(pid=10327): stderr: | (launched: 2022-12-14_04:48:42.437727) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:43.070743 run osmo-nitb_10.42.42.2(pid=10327): stdout: | (launched: 2022-12-14_04:48:42.389154) 04:48:43.212465 run osmo-nitb_10.42.42.2(pid=10327): stderr: | (launched: 2022-12-14_04:48:42.437727) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10327) [trial-2399↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10327)] 04:48:43.572075 tst osmo-nitb_10.42.42.2(pid=10327): stdout: | (launched: 2022-12-14_04:48:42.389154) 04:48:43.704390 tst osmo-nitb_10.42.42.2(pid=10327): stderr: | (launched: 2022-12-14_04:48:42.437727) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:43.860764 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=10327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10327) [trial-2399↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10327)] [trial-2399↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 04:48:43.869964 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 04:48:43.876870 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10326): Terminating (SIGTERM) 04:48:44.088240 --- ParallelTerminationStrategy: PID 10326 died... 04:48:44.109960 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10326): Terminated: ok {rc=0} ---------------------------------------------- trial-2399 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 04:48:44.161718 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:44.183425 tst esme_connect_policy_closed.py: using MSISDN 8509 04:48:44.314639 tst esme_connect_policy_closed.py: using MSISDN 8510 04:48:44.434838 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:45.042283 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10328): Launched 04:48:45.369330 run osmo-nitb_10.42.42.2(pid=10329): Launched 04:48:45.546626 run osmo-nitb_10.42.42.2(pid=10329): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10329)] 04:48:45.681808 run osmo-nitb_10.42.42.2(pid=10329): stdout: | (launched: 2022-12-14_04:48:45.309262) 04:48:45.818504 run osmo-nitb_10.42.42.2(pid=10329): stderr: | (launched: 2022-12-14_04:48:45.357944) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:45.972030 run osmo-nitb_10.42.42.2(pid=10329): stdout: | (launched: 2022-12-14_04:48:45.309262) 04:48:46.100415 run osmo-nitb_10.42.42.2(pid=10329): stderr: | (launched: 2022-12-14_04:48:45.357944) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:46.249114 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=10329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10329) [trial-2399↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10329)] [trial-2399↪nitb_smpp↪esme_connect_policy_closed.py:24] 04:48:46.259740 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 04:48:46.267654 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10328): Terminating (SIGTERM) 04:48:46.477935 --- ParallelTerminationStrategy: PID 10328 died... 04:48:46.503300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10328): Terminated: ok {rc=0} ---------------------------------------------- trial-2399 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:48:46.574412 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:46.588229 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:48:46.639715 tst esme_ms_sms_storeforward.py: using LAC 38654 04:48:46.770906 tst esme_ms_sms_storeforward.py: using RAC 149 04:48:46.904721 tst esme_ms_sms_storeforward.py: using CellId 38654 04:48:47.033942 tst esme_ms_sms_storeforward.py: using BVCI 38655 04:48:47.158022 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:48:47.297386 tst esme_ms_sms_storeforward.py: using MSISDN 8511 04:48:47.417278 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 04:48:47.638975 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:48.306260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10330): Launched 04:48:48.634166 run osmo-nitb_10.42.42.2(pid=10331): Launched 04:48:48.812241 run osmo-nitb_10.42.42.2(pid=10331): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10331)] 04:48:48.947707 run osmo-nitb_10.42.42.2(pid=10331): stdout: | (launched: 2022-12-14_04:48:48.574018) 04:48:49.084304 run osmo-nitb_10.42.42.2(pid=10331): stderr: | (launched: 2022-12-14_04:48:48.622735) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:49.221586 run osmo-nitb_10.42.42.2(pid=10331): stdout: | (launched: 2022-12-14_04:48:48.574018) 04:48:49.352816 run osmo-nitb_10.42.42.2(pid=10331): stderr: | (launched: 2022-12-14_04:48:48.622735) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:49.508688 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=10331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10331) [trial-2399↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10331)] [trial-2399↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 04:48:49.518011 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 04:48:49.525072 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10330): Terminating (SIGTERM) 04:48:49.735842 --- ParallelTerminationStrategy: PID 10330 died... 04:48:49.757347 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10330): Terminated: ok {rc=0} 04:48:49.846359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:48:50.932762 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 04:48:50.944671 tst nitb_smpp: Using 1 x bts (candidates: 1) 04:48:50.980899 tst esme_ms_sms_transaction.py: using LAC 38655 04:48:51.110678 tst esme_ms_sms_transaction.py: using RAC 150 04:48:51.240181 tst esme_ms_sms_transaction.py: using CellId 38655 04:48:51.361555 tst esme_ms_sms_transaction.py: using BVCI 38656 04:48:51.474388 tst nitb_smpp: Using 1 x modem (candidates: 1) 04:48:51.605187 tst esme_ms_sms_transaction.py: using MSISDN 8512 04:48:51.725128 tst esme_ms_sms_transaction.py:18: start nitb and bts... 04:48:51.944821 run osmo-nitb_10.42.42.2: Starting osmo-nitb 04:48:52.607949 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10332): Launched 04:48:52.934483 run osmo-nitb_10.42.42.2(pid=10333): Launched 04:48:53.116911 run osmo-nitb_10.42.42.2(pid=10333): ERR: Terminated: ERROR {rc=2} [trial-2399↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10333)] 04:48:53.263753 run osmo-nitb_10.42.42.2(pid=10333): stdout: | (launched: 2022-12-14_04:48:52.874436) 04:48:53.412681 run osmo-nitb_10.42.42.2(pid=10333): stderr: | (launched: 2022-12-14_04:48:52.923049) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:53.560908 run osmo-nitb_10.42.42.2(pid=10333): stdout: | (launched: 2022-12-14_04:48:52.874436) 04:48:53.702987 run osmo-nitb_10.42.42.2(pid=10333): stderr: | (launched: 2022-12-14_04:48:52.923049) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f9b150c0268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10333) [trial-2399↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10333)] 04:48:54.059835 tst osmo-nitb_10.42.42.2(pid=10333): stdout: | (launched: 2022-12-14_04:48:52.874436) 04:48:54.192914 tst osmo-nitb_10.42.42.2(pid=10333): stderr: | (launched: 2022-12-14_04:48:52.923049) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 04:48:54.350028 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=10333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10333) [trial-2399↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10333)] [trial-2399↪nitb_smpp↪esme_ms_sms_transaction.py:21] 04:48:54.359345 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 04:48:54.366617 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10332): Terminating (SIGTERM) 04:48:54.578703 --- ParallelTerminationStrategy: PID 10332 died... 04:48:54.600732 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10332): Terminated: ok {rc=0} 04:48:54.690454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 smpp --------------------------------------------------------------------- 04:48:55.857391 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:48:55.860208 tst smpp: Verifying 1 x bts (candidates: 11) 04:48:55.881464 tst smpp: Verifying 6 x ip_address (candidates: 9) 04:48:55.910558 tst smpp: Verifying 1 x modem (candidates: 12) 04:48:55.947696 tst smpp: Reserving 1 x bts (candidates: 11) 04:48:55.969633 tst smpp: Reserving 6 x ip_address (candidates: 9) 04:48:55.997410 tst smpp: Reserving 1 x modem (candidates: 12) 04:48:56.525594 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 04:48:56.530767 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.541691 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.552449 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.563222 tst smpp: Using 1 x ip_address (candidates: 6) 04:48:56.584422 tst esme_connect_policy_acceptall.py: using MSISDN 8513 04:48:56.707967 run osmo-stp_10.42.42.4: Starting osmo-stp 04:48:57.267961 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10337): Launched 04:48:57.595926 run osmo-stp_10.42.42.4(pid=10338): Launched 04:48:57.720469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:48:58.227957 run create_hlr_db(pid=10339): Launched 04:48:58.353179 bus /sierra_2: Setting Powered False 04:48:59.417549 run create_hlr_db(pid=10339): Terminated: ok {rc=0} 04:48:59.854589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Launched 04:49:00.160748 run osmo-hlr_10.42.42.2(pid=10342): Launched 04:49:00.276535 run osmo-msc_10.42.42.5: Starting osmo-msc 04:49:00.837670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Launched 04:49:01.195633 run osmo-msc_10.42.42.5(pid=10345): Launched 04:49:01.390457 run osmo-hlr_10.42.42.2(pid=10342): ERR: Terminated: ERROR {rc=237} [trial-2399↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10342)] 04:49:01.719231 run osmo-hlr_10.42.42.2(pid=10342): stdout: | (launched: 2022-12-14_04:49:00.104290) 04:49:02.110673 run osmo-hlr_10.42.42.2(pid=10342): stderr: | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044900291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:02.284858 run osmo-hlr_10.42.42.2(pid=10342): stdout: | (launched: 2022-12-14_04:49:00.104290) 04:49:02.424889 run osmo-hlr_10.42.42.2(pid=10342): stderr: | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044900279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044900280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044900291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044900300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:02.583100 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=10342): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10342) [trial-2399↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10342)] [trial-2399↪smpp↪esme_connect_policy_acceptall.py:23] 04:49:02.592195 tst esme_connect_policy_acceptall.py:23: Test FAILED (6.1 sec) 04:49:02.619857 run osmo-msc_10.42.42.5(pid=10345): ERR: Terminated: ERROR {rc=9} [trial-2399↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=10345)] 04:49:02.671337 run osmo-msc_10.42.42.5(pid=10345): stdout: | (launched: 2022-12-14_04:49:01.134553) 04:49:02.724155 run osmo-msc_10.42.42.5(pid=10345): stderr: | [0;m[38;5;43m20221214044901867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214044901867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214044901867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214044901867 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214044901867 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214044901868 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214044901868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214044901869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214044901869 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:49:02.777297 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10337): Terminating (SIGTERM) 04:49:02.819495 run osmo-stp_10.42.42.4(pid=10338): Terminating (SIGTERM) 04:49:02.862323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Terminating (SIGTERM) 04:49:02.907090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Terminating (SIGTERM) 04:49:02.953328 --- ParallelTerminationStrategy: PID 10337 died... 04:49:02.975367 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10337): Terminated: ok {rc=0} 04:49:03.024892 --- ParallelTerminationStrategy: PID 10338 died... 04:49:03.045458 run osmo-stp_10.42.42.4(pid=10338): Terminated: ok {rc=0} 04:49:03.092181 --- ParallelTerminationStrategy: PID 10341 died... 04:49:03.112193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Terminated: ok {rc=0} 04:49:03.159070 --- ParallelTerminationStrategy: PID 10344 died... 04:49:03.179142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Terminated: ok {rc=0} ---------------------------------------------- trial-2399 smpp esme_connect_policy_closed.py ---------------------------------------------- 04:49:03.231215 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:03.242953 tst smpp: Using 1 x bts (candidates: 1) 04:49:03.278062 tst esme_connect_policy_closed.py: using LAC 38656 04:49:03.409918 tst esme_connect_policy_closed.py: using RAC 151 04:49:03.531720 tst esme_connect_policy_closed.py: using CellId 38656 04:49:03.657571 tst esme_connect_policy_closed.py: using BVCI 38657 04:49:03.769817 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:03.780311 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:03.791726 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:03.810929 tst esme_connect_policy_closed.py: using MSISDN 8514 04:49:03.930786 tst esme_connect_policy_closed.py: using MSISDN 8515 04:49:04.042454 run osmo-stp_10.42.42.4: Starting osmo-stp 04:49:04.564586 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10348): Launched 04:49:04.872871 run osmo-stp_10.42.42.4(pid=10349): Launched 04:49:04.990180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:05.469317 run create_hlr_db(pid=10350): Launched 04:49:06.649309 run create_hlr_db(pid=10350): Terminated: ok {rc=0} 04:49:06.974192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10352): Launched 04:49:07.281566 run osmo-hlr_10.42.42.2(pid=10353): Launched 04:49:07.399344 run osmo-msc_10.42.42.5: Starting osmo-msc 04:49:07.963340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10355): Launched 04:49:08.273081 run osmo-msc_10.42.42.5(pid=10356): Launched 04:49:08.445711 run osmo-hlr_10.42.42.2(pid=10353): ERR: Terminated: ERROR {rc=237} [trial-2399↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10353)] 04:49:08.576006 run osmo-hlr_10.42.42.2(pid=10353): stdout: | (launched: 2022-12-14_04:49:07.224220) 04:49:08.705960 run osmo-hlr_10.42.42.2(pid=10353): stderr: | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044907414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:08.834307 run osmo-hlr_10.42.42.2(pid=10353): stdout: | (launched: 2022-12-14_04:49:07.224220) 04:49:08.956094 run osmo-hlr_10.42.42.2(pid=10353): stderr: | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044907402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044907414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044907422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:09.102185 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=10353): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10353) [trial-2399↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10353)] [trial-2399↪smpp↪esme_connect_policy_closed.py:31] 04:49:09.110454 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 04:49:09.136500 run osmo-msc_10.42.42.5(pid=10356): ERR: Terminated: ERROR {rc=9} [trial-2399↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=10356)] 04:49:09.184787 run osmo-msc_10.42.42.5(pid=10356): stdout: | (launched: 2022-12-14_04:49:08.214782) 04:49:09.234295 run osmo-msc_10.42.42.5(pid=10356): stderr: | [0;m[38;5;43m20221214044908533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214044908533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214044908533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214044908533 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214044908533 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214044908533 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214044908533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214044908534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214044908534 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 04:49:09.283846 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10348): Terminating (SIGTERM) 04:49:09.323689 run osmo-stp_10.42.42.4(pid=10349): Terminating (SIGTERM) 04:49:09.363787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10352): Terminating (SIGTERM) 04:49:09.405336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10355): Terminating (SIGTERM) 04:49:09.446385 --- ParallelTerminationStrategy: PID 10348 died... 04:49:09.465896 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10348): Terminated: ok {rc=0} 04:49:09.510334 --- ParallelTerminationStrategy: PID 10349 died... 04:49:09.529381 run osmo-stp_10.42.42.4(pid=10349): Terminated: ok {rc=0} 04:49:09.573721 --- ParallelTerminationStrategy: PID 10352 died... 04:49:09.592672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10352): Terminated: ok {rc=0} 04:49:09.636882 --- ParallelTerminationStrategy: PID 10355 died... 04:49:09.656154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10355): Terminated: ok {rc=0} ---------------------------------------------- trial-2399 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 04:49:09.705832 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:09.717068 tst smpp: Using 1 x bts (candidates: 1) 04:49:09.752345 tst esme_ms_sms_storeforward.py: using LAC 38657 04:49:09.883169 tst esme_ms_sms_storeforward.py: using RAC 152 04:49:10.013818 tst esme_ms_sms_storeforward.py: using CellId 38657 04:49:10.142404 tst esme_ms_sms_storeforward.py: using BVCI 38658 04:49:10.263623 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:10.274589 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:10.285486 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:10.296413 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:10.307515 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:10.318857 tst smpp: Using 1 x modem (candidates: 1) 04:49:10.452384 tst esme_ms_sms_storeforward.py: using MSISDN 8516 04:49:10.572227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:11.083944 run create_hlr_db(pid=10359): Launched 04:49:12.268778 run create_hlr_db(pid=10359): Terminated: ok {rc=0} 04:49:12.616740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Launched 04:49:12.946525 run osmo-hlr_10.42.42.2(pid=10362): Launched 04:49:13.074020 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:13.644833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Launched 04:49:13.974694 run osmo-stp_10.42.42.5(pid=10365): Launched 04:49:14.103633 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:14.699276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Launched 04:49:15.029496 run osmo-msc_10.42.42.6(pid=10368): Launched 04:49:15.213563 run osmo-stp_10.42.42.5(pid=10365): ERR: Terminated: ERROR {rc=1} [trial-2399↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] 04:49:15.357272 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-14_04:49:13.913877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:15.497087 run osmo-stp_10.42.42.5(pid=10365): stderr: | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044914108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:15.634358 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-14_04:49:13.913877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:15.765344 run osmo-stp_10.42.42.5(pid=10365): stderr: | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044914107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044914108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044914108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:15.923985 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2399↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] [trial-2399↪smpp↪esme_ms_sms_storeforward.py:30] 04:49:15.934240 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 04:49:15.962535 run osmo-hlr_10.42.42.2(pid=10362): ERR: Terminated: ERROR {rc=237} [trial-2399↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10362)] 04:49:16.017832 run osmo-hlr_10.42.42.2(pid=10362): stdout: | (launched: 2022-12-14_04:49:12.886059) 04:49:16.072202 run osmo-hlr_10.42.42.2(pid=10362): stderr: | [0;m[1;31m20221214044913084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044913085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044913085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044913085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044913085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044913085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044913096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044913104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044913105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044913105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:16.147838 run osmo-msc_10.42.42.6(pid=10368): ERR: Terminated: ERROR {rc=2} [trial-2399↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10368)] 04:49:16.199367 run osmo-msc_10.42.42.6(pid=10368): stdout: | (launched: 2022-12-14_04:49:14.967993) 04:49:16.254678 run osmo-msc_10.42.42.6(pid=10368): stderr: | [0;m[38;5;43m20221214044915291 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044915291 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89f9ac3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044915291 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044915291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044915291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044915291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044915293 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044915294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044915294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044915294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:16.309998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminating (SIGTERM) 04:49:16.353896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminating (SIGTERM) 04:49:16.399596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminating (SIGTERM) 04:49:16.444124 --- ParallelTerminationStrategy: PID 10361 died... 04:49:16.466137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminated: ok {rc=0} 04:49:16.515140 --- ParallelTerminationStrategy: PID 10364 died... 04:49:16.537137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminated: ok {rc=0} 04:49:16.586257 --- ParallelTerminationStrategy: PID 10367 died... 04:49:16.607973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10367): Terminated: ok {rc=0} 04:49:16.700150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 smpp esme_ms_sms_transaction.py ---------------------------------------------- 04:49:17.789120 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:17.801218 tst smpp: Using 1 x bts (candidates: 1) 04:49:17.838332 tst esme_ms_sms_transaction.py: using LAC 38658 04:49:17.969945 tst esme_ms_sms_transaction.py: using RAC 153 04:49:18.099534 tst esme_ms_sms_transaction.py: using CellId 38658 04:49:18.227396 tst esme_ms_sms_transaction.py: using BVCI 38659 04:49:18.339346 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:18.350009 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:18.360518 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:18.370762 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:18.381167 tst smpp: Using 1 x ip_address (candidates: 6) 04:49:18.391512 tst smpp: Using 1 x modem (candidates: 1) 04:49:18.526719 tst esme_ms_sms_transaction.py: using MSISDN 8517 04:49:18.648228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:19.158559 run create_hlr_db(pid=10370): Launched 04:49:19.283557 bus /sierra_2: Setting Powered False 04:49:20.348675 run create_hlr_db(pid=10370): Terminated: ok {rc=0} 04:49:20.789288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Launched 04:49:21.098508 run osmo-hlr_10.42.42.2(pid=10373): Launched 04:49:21.218446 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:21.746653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Launched 04:49:22.053835 run osmo-stp_10.42.42.5(pid=10376): Launched 04:49:22.170404 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:22.725275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Launched 04:49:23.033186 run osmo-msc_10.42.42.6(pid=10379): Launched 04:49:23.204545 run osmo-stp_10.42.42.5(pid=10376): ERR: Terminated: ERROR {rc=1} [trial-2399↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] 04:49:23.334660 run osmo-stp_10.42.42.5(pid=10376): stdout: | (launched: 2022-12-14_04:49:21.996744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:23.464070 run osmo-stp_10.42.42.5(pid=10376): stderr: | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044922169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:23.592484 run osmo-stp_10.42.42.5(pid=10376): stdout: | (launched: 2022-12-14_04:49:21.996744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:23.714098 run osmo-stp_10.42.42.5(pid=10376): stderr: | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044922168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044922169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044922169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:23.859742 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=10376): Process ended prematurely: osmo-stp_10.42.42.5(pid=10376) [trial-2399↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] [trial-2399↪smpp↪esme_ms_sms_transaction.py:28] 04:49:23.868229 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 04:49:23.894290 run osmo-hlr_10.42.42.2(pid=10373): ERR: Terminated: ERROR {rc=237} [trial-2399↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10373)] 04:49:23.942666 run osmo-hlr_10.42.42.2(pid=10373): stdout: | (launched: 2022-12-14_04:49:21.041194) 04:49:23.992193 run osmo-hlr_10.42.42.2(pid=10373): stderr: | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044921217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044921230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:24.061414 run osmo-msc_10.42.42.6(pid=10379): ERR: Terminated: ERROR {rc=2} [trial-2399↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10379)] 04:49:24.109451 run osmo-msc_10.42.42.6(pid=10379): stdout: | (launched: 2022-12-14_04:49:22.975213) 04:49:24.159242 run osmo-msc_10.42.42.6(pid=10379): stderr: | [0;m[38;5;43m20221214044923249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044923249 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5573904c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044923249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044923249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044923250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044923250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044923252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044923252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044923252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044923252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:24.209801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Terminating (SIGTERM) 04:49:24.249506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Terminating (SIGTERM) 04:49:24.289611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Terminating (SIGTERM) 04:49:24.329388 --- ParallelTerminationStrategy: PID 10372 died... 04:49:24.348730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10372): Terminated: ok {rc=0} 04:49:24.392884 --- ParallelTerminationStrategy: PID 10375 died... 04:49:24.411719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10375): Terminated: ok {rc=0} 04:49:24.455810 --- ParallelTerminationStrategy: PID 10378 died... 04:49:24.474618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10378): Terminated: ok {rc=0} 04:49:24.560461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 encryption --------------------------------------------------------------------- 04:49:25.754728 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:49:25.757826 tst encryption: Verifying 1 x bts (candidates: 11) 04:49:25.778549 tst encryption: Verifying 6 x ip_address (candidates: 9) 04:49:25.805349 tst encryption: Verifying 1 x modem (candidates: 12) 04:49:25.840704 tst encryption: Reserving 1 x bts (candidates: 11) 04:49:25.861875 tst encryption: Reserving 6 x ip_address (candidates: 9) 04:49:25.888274 tst encryption: Reserving 1 x modem (candidates: 12) 04:49:26.416400 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2399 encryption register_a5_0_authopt.py ---------------------------------------------- 04:49:26.467649 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:26.478398 tst encryption: Using 1 x bts (candidates: 1) 04:49:26.512871 tst register_a5_0_authopt.py: using LAC 38659 04:49:26.641516 tst register_a5_0_authopt.py: using RAC 154 04:49:26.762716 tst register_a5_0_authopt.py: using CellId 38659 04:49:26.884735 tst register_a5_0_authopt.py: using BVCI 38660 04:49:26.997500 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:27.007907 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:27.018297 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:27.028496 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:27.038792 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:27.049086 tst encryption: Using 1 x modem (candidates: 1) 04:49:27.169470 tst register_a5_0_authopt.py:8: start network... 04:49:27.394450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:27.910020 run create_hlr_db(pid=10385): Launched 04:49:28.038686 bus /sierra_2: Setting Powered False 04:49:29.103817 run create_hlr_db(pid=10385): Terminated: ok {rc=0} 04:49:29.550375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10387): Launched 04:49:29.861828 run osmo-hlr_10.42.42.2(pid=10388): Launched 04:49:29.980512 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:30.514805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10390): Launched 04:49:30.826103 run osmo-stp_10.42.42.5(pid=10391): Launched 04:49:31.125755 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:31.701958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10393): Launched 04:49:32.032030 run osmo-msc_10.42.42.6(pid=10394): Launched 04:49:32.390794 run osmo-stp_10.42.42.5(pid=10391): ERR: Terminated: ERROR {rc=1} [trial-2399↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10391)] 04:49:32.556567 run osmo-stp_10.42.42.5(pid=10391): stdout: | (launched: 2022-12-14_04:49:30.767436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:32.711009 run osmo-stp_10.42.42.5(pid=10391): stderr: | [0;m[38;5;43m20221214044931036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044931037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044931037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044931037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:32.852184 run osmo-stp_10.42.42.5(pid=10391): stdout: | (launched: 2022-12-14_04:49:30.767436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:32.984463 run osmo-stp_10.42.42.5(pid=10391): stderr: | [0;m[38;5;43m20221214044931036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044931037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044931037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044931037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044931038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:33.142566 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10391): Process ended prematurely: osmo-stp_10.42.42.5(pid=10391) [trial-2399↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10391)] [trial-2399↪encryption↪register_a5_0_authopt.py:8] 04:49:33.152129 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 04:49:33.179996 run osmo-hlr_10.42.42.2(pid=10388): ERR: Terminated: ERROR {rc=237} [trial-2399↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10388)] 04:49:33.231269 run osmo-hlr_10.42.42.2(pid=10388): stdout: | (launched: 2022-12-14_04:49:29.803797) 04:49:33.283654 run osmo-hlr_10.42.42.2(pid=10388): stderr: | [0;m[1;31m20221214044929982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044929982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044929982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044929983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044929983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044929983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044929995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044930003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044930003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044930003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:33.357403 run osmo-msc_10.42.42.6(pid=10394): ERR: Terminated: ERROR {rc=2} [trial-2399↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10394)] 04:49:33.407651 run osmo-msc_10.42.42.6(pid=10394): stdout: | (launched: 2022-12-14_04:49:31.969772) 04:49:33.460238 run osmo-msc_10.42.42.6(pid=10394): stderr: | [0;m[38;5;43m20221214044932571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044932571 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02ebe47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044932571 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044932571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044932572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044932572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044932573 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044932574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044932574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044932574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:33.513202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10387): Terminating (SIGTERM) 04:49:33.555469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10390): Terminating (SIGTERM) 04:49:33.598621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10393): Terminating (SIGTERM) 04:49:33.641226 --- ParallelTerminationStrategy: PID 10387 died... 04:49:33.661673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10387): Terminated: ok {rc=0} 04:49:33.708183 --- ParallelTerminationStrategy: PID 10390 died... 04:49:33.728238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10390): Terminated: ok {rc=0} 04:49:33.774650 --- ParallelTerminationStrategy: PID 10393 died... 04:49:33.794623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10393): Terminated: ok {rc=0} 04:49:33.883359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 encryption register_a5_0_authreq.py ---------------------------------------------- 04:49:35.034959 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.046743 tst encryption: Using 1 x bts (candidates: 1) 04:49:35.081672 tst register_a5_0_authreq.py: using LAC 38660 04:49:35.212734 tst register_a5_0_authreq.py: using RAC 155 04:49:35.343711 tst register_a5_0_authreq.py: using CellId 38660 04:49:35.475250 tst register_a5_0_authreq.py: using BVCI 38661 04:49:35.590214 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.601082 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.611667 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.622019 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.632898 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:35.644041 tst encryption: Using 1 x modem (candidates: 1) 04:49:35.765335 tst register_a5_0_authreq.py:8: start network... 04:49:35.990206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:36.506021 run create_hlr_db(pid=10396): Launched 04:49:36.636712 bus /sierra_2: Setting Powered False 04:49:37.702180 run create_hlr_db(pid=10396): Terminated: ok {rc=0} 04:49:38.145630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10398): Launched 04:49:38.456908 run osmo-hlr_10.42.42.2(pid=10399): Launched 04:49:38.575722 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:39.110501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10401): Launched 04:49:39.420844 run osmo-stp_10.42.42.5(pid=10402): Launched 04:49:39.539585 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:40.102878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10404): Launched 04:49:40.416138 run osmo-msc_10.42.42.6(pid=10405): Launched 04:49:40.590159 run osmo-stp_10.42.42.5(pid=10402): ERR: Terminated: ERROR {rc=1} [trial-2399↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10402)] 04:49:40.720726 run osmo-stp_10.42.42.5(pid=10402): stdout: | (launched: 2022-12-14_04:49:39.363053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:40.852005 run osmo-stp_10.42.42.5(pid=10402): stderr: | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044939536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:40.980726 run osmo-stp_10.42.42.5(pid=10402): stdout: | (launched: 2022-12-14_04:49:39.363053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:41.103769 run osmo-stp_10.42.42.5(pid=10402): stderr: | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044939536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044939536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044939537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:41.250870 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10402): Process ended prematurely: osmo-stp_10.42.42.5(pid=10402) [trial-2399↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10402)] [trial-2399↪encryption↪register_a5_0_authreq.py:8] 04:49:41.259899 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 04:49:41.286253 run osmo-hlr_10.42.42.2(pid=10399): ERR: Terminated: ERROR {rc=237} [trial-2399↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10399)] 04:49:41.333984 run osmo-hlr_10.42.42.2(pid=10399): stdout: | (launched: 2022-12-14_04:49:38.399130) 04:49:41.383428 run osmo-hlr_10.42.42.2(pid=10399): stderr: | [0;m[1;31m20221214044938576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044938576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044938576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044938577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044938577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044938577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044938589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044938597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044938597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044938597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:41.452071 run osmo-msc_10.42.42.6(pid=10405): ERR: Terminated: ERROR {rc=2} [trial-2399↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10405)] 04:49:41.499569 run osmo-msc_10.42.42.6(pid=10405): stdout: | (launched: 2022-12-14_04:49:40.358171) 04:49:41.548694 run osmo-msc_10.42.42.6(pid=10405): stderr: | [0;m[38;5;43m20221214044940631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044940631 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f479430ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044940631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044940631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044940632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044940632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044940634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044940634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044940634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044940634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:41.598433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10398): Terminating (SIGTERM) 04:49:41.638466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10401): Terminating (SIGTERM) 04:49:41.677928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10404): Terminating (SIGTERM) 04:49:41.717618 --- ParallelTerminationStrategy: PID 10398 died... 04:49:41.736701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10398): Terminated: ok {rc=0} 04:49:41.780531 --- ParallelTerminationStrategy: PID 10401 died... 04:49:41.799152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10401): Terminated: ok {rc=0} 04:49:41.842701 --- ParallelTerminationStrategy: PID 10404 died... 04:49:41.861396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10404): Terminated: ok {rc=0} 04:49:41.943992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 encryption register_a5_1_authreq.py ---------------------------------------------- 04:49:43.095627 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.107475 tst encryption: Using 1 x bts (candidates: 1) 04:49:43.145366 tst register_a5_1_authreq.py: using LAC 38661 04:49:43.267993 tst register_a5_1_authreq.py: using RAC 156 04:49:43.390481 tst register_a5_1_authreq.py: using CellId 38661 04:49:43.515134 tst register_a5_1_authreq.py: using BVCI 38662 04:49:43.630174 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.640839 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.651439 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.661882 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.672217 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:43.683860 tst encryption: Using 1 x modem (candidates: 1) 04:49:43.804470 tst register_a5_1_authreq.py:8: start network... 04:49:44.030182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:44.547976 run create_hlr_db(pid=10407): Launched 04:49:44.677900 bus /sierra_2: Setting Powered False 04:49:45.743599 run create_hlr_db(pid=10407): Terminated: ok {rc=0} 04:49:46.226481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10409): Launched 04:49:46.558783 run osmo-hlr_10.42.42.2(pid=10410): Launched 04:49:46.801523 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:47.528855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10412): Launched 04:49:47.840143 run osmo-stp_10.42.42.5(pid=10413): Launched 04:49:47.958148 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:48.518412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10415): Launched 04:49:48.831213 run osmo-msc_10.42.42.6(pid=10416): Launched 04:49:49.006888 run osmo-stp_10.42.42.5(pid=10413): ERR: Terminated: ERROR {rc=1} [trial-2399↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10413)] 04:49:49.138314 run osmo-stp_10.42.42.5(pid=10413): stdout: | (launched: 2022-12-14_04:49:47.782236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:49.269718 run osmo-stp_10.42.42.5(pid=10413): stderr: | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044947956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:49.398944 run osmo-stp_10.42.42.5(pid=10413): stdout: | (launched: 2022-12-14_04:49:47.782236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:49.522155 run osmo-stp_10.42.42.5(pid=10413): stderr: | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044947956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044947956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044947957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:49.669725 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10413): Process ended prematurely: osmo-stp_10.42.42.5(pid=10413) [trial-2399↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10413)] [trial-2399↪encryption↪register_a5_1_authreq.py:8] 04:49:49.678917 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 04:49:49.705267 run osmo-hlr_10.42.42.2(pid=10410): ERR: Terminated: ERROR {rc=237} [trial-2399↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10410)] 04:49:49.752687 run osmo-hlr_10.42.42.2(pid=10410): stdout: | (launched: 2022-12-14_04:49:46.499178) 04:49:49.801878 run osmo-hlr_10.42.42.2(pid=10410): stderr: | [0;m[1;31m20221214044946836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044946836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044946836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044946836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044946836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044946845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044946861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044946879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044946879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044946879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:49.870745 run osmo-msc_10.42.42.6(pid=10416): ERR: Terminated: ERROR {rc=2} [trial-2399↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10416)] 04:49:49.918026 run osmo-msc_10.42.42.6(pid=10416): stdout: | (launched: 2022-12-14_04:49:48.773064) 04:49:49.966906 run osmo-msc_10.42.42.6(pid=10416): stderr: | [0;m[38;5;43m20221214044949048 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044949048 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d5762ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044949048 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044949048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044949049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044949049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044949051 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044949051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044949051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044949051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:50.016363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10409): Terminating (SIGTERM) 04:49:50.055651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10412): Terminating (SIGTERM) 04:49:50.095143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10415): Terminating (SIGTERM) 04:49:50.134780 --- ParallelTerminationStrategy: PID 10409 died... 04:49:50.153809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10409): Terminated: ok {rc=0} 04:49:50.197359 --- ParallelTerminationStrategy: PID 10412 died... 04:49:50.215887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10412): Terminated: ok {rc=0} 04:49:50.259139 --- ParallelTerminationStrategy: PID 10415 died... 04:49:50.277650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10415): Terminated: ok {rc=0} 04:49:50.363117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2399 encryption register_a5_3_authreq.py ---------------------------------------------- 04:49:51.511631 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:51.522889 tst encryption: Using 1 x bts (candidates: 1) 04:49:51.559308 tst register_a5_3_authreq.py: using LAC 38662 04:49:51.691696 tst register_a5_3_authreq.py: using RAC 157 04:49:51.827860 tst register_a5_3_authreq.py: using CellId 38662 04:49:51.960175 tst register_a5_3_authreq.py: using BVCI 38663 04:49:52.082236 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:52.093727 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:52.104677 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:52.115683 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:52.127003 tst encryption: Using 1 x ip_address (candidates: 6) 04:49:52.138293 tst encryption: Using 1 x modem (candidates: 1) 04:49:52.266889 tst register_a5_3_authreq.py:8: start network... 04:49:52.475517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:49:52.956316 run create_hlr_db(pid=10418): Launched 04:49:53.083384 bus /sierra_2: Setting Powered False 04:49:54.145126 run create_hlr_db(pid=10418): Terminated: ok {rc=0} 04:49:54.599413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Launched 04:49:54.933992 run osmo-hlr_10.42.42.2(pid=10421): Launched 04:49:55.063383 run osmo-stp_10.42.42.5: Starting osmo-stp 04:49:55.618374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Launched 04:49:55.930731 run osmo-stp_10.42.42.5(pid=10424): Launched 04:49:56.048390 run osmo-msc_10.42.42.6: Starting osmo-msc 04:49:56.610021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Launched 04:49:56.921703 run osmo-msc_10.42.42.6(pid=10427): Launched 04:49:57.094870 run osmo-stp_10.42.42.5(pid=10424): ERR: Terminated: ERROR {rc=1} [trial-2399↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] 04:49:57.225982 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-14_04:49:55.872870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:57.357645 run osmo-stp_10.42.42.5(pid=10424): stderr: | [0;m[38;5;43m20221214044956045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044956046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044956046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044956046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:57.486900 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-14_04:49:55.872870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:49:57.610277 run osmo-stp_10.42.42.5(pid=10424): stderr: | [0;m[38;5;43m20221214044956045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214044956046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214044956046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214044956046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214044956047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:49:57.758664 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2399↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] [trial-2399↪encryption↪register_a5_3_authreq.py:8] 04:49:57.767570 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 04:49:57.793782 run osmo-hlr_10.42.42.2(pid=10421): ERR: Terminated: ERROR {rc=237} [trial-2399↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10421)] 04:49:57.841191 run osmo-hlr_10.42.42.2(pid=10421): stdout: | (launched: 2022-12-14_04:49:54.872667) 04:49:57.890332 run osmo-hlr_10.42.42.2(pid=10421): stderr: | [0;m[1;31m20221214044955072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214044955072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214044955072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214044955072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214044955072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214044955073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214044955084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214044955092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214044955093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214044955093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:49:57.958861 run osmo-msc_10.42.42.6(pid=10427): ERR: Terminated: ERROR {rc=2} [trial-2399↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10427)] 04:49:58.006242 run osmo-msc_10.42.42.6(pid=10427): stdout: | (launched: 2022-12-14_04:49:56.863772) 04:49:58.055350 run osmo-msc_10.42.42.6(pid=10427): stderr: | [0;m[38;5;43m20221214044957138 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214044957138 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6b2744c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214044957138 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214044957138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214044957138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214044957139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214044957140 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214044957141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214044957141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214044957141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:49:58.104919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminating (SIGTERM) 04:49:58.144245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminating (SIGTERM) 04:49:58.183557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Terminating (SIGTERM) 04:49:58.223051 --- ParallelTerminationStrategy: PID 10420 died... 04:49:58.242143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminated: ok {rc=0} 04:49:58.285671 --- ParallelTerminationStrategy: PID 10423 died... 04:49:58.303948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminated: ok {rc=0} 04:49:58.347639 --- ParallelTerminationStrategy: PID 10426 died... 04:49:58.366163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10426): Terminated: ok {rc=0} 04:49:58.451783 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 04:49:59.659208 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:49:59.663913 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 04:49:59.681937 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 04:49:59.708337 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 04:49:59.735120 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 04:49:59.753655 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 04:49:59.783643 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 04:50:00.296188 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 04:50:00.301320 tst handover.py:11: TEST_CONFIG: {} 04:50:00.526616 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:00.543183 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:00.566767 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:00.616231 tst handover.py: using MSISDN 8518 04:50:00.740331 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8518', subscriber_id=0} 04:50:00.872478 run srsepc_10.42.42.118: Starting srsepc 04:50:02.787060 run rm-remote-dir(pid=10437): Launched 04:50:02.913087 bus /sierra_2: Setting Powered False 04:50:03.978674 run rm-remote-dir(pid=10437): Terminated: ok {rc=0} 04:50:04.444797 run mk-remote-dir(pid=10438): Launched 04:50:05.639895 run mk-remote-dir(pid=10438): Terminated: ok {rc=0} 04:50:05.948676 run scp-inst-to-remote(pid=10439): Launched 04:50:08.141249 run scp-inst-to-remote(pid=10439): Terminated: ok {rc=0} 04:50:08.502774 run rm-remote-dir(pid=10441): Launched 04:50:09.696250 run rm-remote-dir(pid=10441): Terminated: ok {rc=0} 04:50:10.058973 run mk-remote-dir(pid=10442): Launched 04:50:11.250612 run mk-remote-dir(pid=10442): Terminated: ok {rc=0} 04:50:11.559834 run scp-cfg-to-remote(pid=10443): Launched 04:50:12.750200 run scp-cfg-to-remote(pid=10443): Terminated: ok {rc=0} 04:50:13.057305 run scp-db-to-remote(pid=10445): Launched 04:50:14.247515 run scp-db-to-remote(pid=10445): Terminated: ok {rc=0} 04:50:14.389796 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:14.723104 run patchelf(pid=10447): Launched 04:50:15.929527 run patchelf(pid=10447): Terminated: ok {rc=0} 04:50:16.064582 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:16.427753 run setcap-netadm(pid=10448): Launched 04:50:17.681643 run setcap-netadm(pid=10448): Terminated: ok {rc=0} 04:50:18.031376 run srsepc(pid=10449): Launched 04:50:18.155038 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:19.285158 run rm-remote-dir(pid=10450): Launched 04:50:19.465217 run srsepc(pid=10449): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10449)] 04:50:19.603766 run srsepc(pid=10449): stdout: | (launched: 2022-12-14_04:50:17.969954) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:19.740164 run srsepc(pid=10449): stderr: | (launched: 2022-12-14_04:50:18.019344) | Connection to 10.42.42.116 closed. 04:50:19.876188 run srsepc(pid=10449): stdout: | (launched: 2022-12-14_04:50:17.969954) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:20.007630 run srsepc(pid=10449): stderr: | (launched: 2022-12-14_04:50:18.019344) | Connection to 10.42.42.116 closed. 04:50:20.162925 run rm-remote-dir(pid=10450): Terminating (SIGINT) 04:50:20.342130 run rm-remote-dir(pid=10450): Terminated: ok {rc=0} 04:50:20.471082 tst handover.py:37: ERR: Error: srsepc(pid=10449): Process ended prematurely: srsepc(pid=10449) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10449)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 04:50:20.480855 tst handover.py:37: Test FAILED (20.2 sec) 04:50:20.558869 run scp-back-log(pid=10451): Launched 04:50:21.638059 run scp-back-log(pid=10451): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10451)] 04:50:21.699132 run scp-back-log(pid=10451): stdout: | (launched: 2022-12-14_04:50:20.527232) 04:50:21.761451 run scp-back-log(pid=10451): stderr: | (launched: 2022-12-14_04:50:20.546976) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:21.831568 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10451): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10451)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 04:50:21.876412 tst iperf3_bidir.py:13: Number of physical ue: 1 04:50:22.084165 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:22.126511 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 04:50:22.332053 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:22.347693 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:22.380008 tst iperf3_bidir.py: using MSISDN 8519 04:50:22.491783 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8519', subscriber_id=0} 04:50:22.599282 run srsepc_10.42.42.118: Starting srsepc 04:50:23.231678 run rm-remote-dir(pid=10453): Launched 04:50:24.412865 run rm-remote-dir(pid=10453): Terminated: ok {rc=0} 04:50:24.751691 run mk-remote-dir(pid=10454): Launched 04:50:25.932208 run mk-remote-dir(pid=10454): Terminated: ok {rc=0} 04:50:26.222490 run scp-inst-to-remote(pid=10455): Launched 04:50:28.403196 run scp-inst-to-remote(pid=10455): Terminated: ok {rc=0} 04:50:28.740394 run rm-remote-dir(pid=10457): Launched 04:50:29.926971 run rm-remote-dir(pid=10457): Terminated: ok {rc=0} 04:50:30.289094 run mk-remote-dir(pid=10458): Launched 04:50:31.483090 run mk-remote-dir(pid=10458): Terminated: ok {rc=0} 04:50:31.800890 run scp-cfg-to-remote(pid=10459): Launched 04:50:33.099945 run scp-cfg-to-remote(pid=10459): Terminated: ok {rc=0} 04:50:33.387334 run scp-db-to-remote(pid=10461): Launched 04:50:34.567230 run scp-db-to-remote(pid=10461): Terminated: ok {rc=0} 04:50:34.699234 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:35.010286 run patchelf(pid=10463): Launched 04:50:36.190130 run patchelf(pid=10463): Terminated: ok {rc=0} 04:50:36.322631 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:36.634193 run setcap-netadm(pid=10464): Launched 04:50:37.813579 run setcap-netadm(pid=10464): Terminated: ok {rc=0} 04:50:38.140758 run srsepc(pid=10465): Launched 04:50:38.257159 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:39.380115 run rm-remote-dir(pid=10466): Launched 04:50:39.559740 run srsepc(pid=10465): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10465)] 04:50:39.697738 run srsepc(pid=10465): stdout: | (launched: 2022-12-14_04:50:38.082778) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:39.833996 run srsepc(pid=10465): stderr: | (launched: 2022-12-14_04:50:38.129112) | Connection to 10.42.42.116 closed. 04:50:39.970174 run srsepc(pid=10465): stdout: | (launched: 2022-12-14_04:50:38.082778) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:40.101952 run srsepc(pid=10465): stderr: | (launched: 2022-12-14_04:50:38.129112) | Connection to 10.42.42.116 closed. 04:50:40.257475 run rm-remote-dir(pid=10466): Terminating (SIGINT) 04:50:40.437301 run rm-remote-dir(pid=10466): Terminated: ok {rc=0} 04:50:40.566997 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=10465): Process ended prematurely: srsepc(pid=10465) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10465)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 04:50:40.577218 tst iperf3_bidir.py:42: Test FAILED (18.7 sec) 04:50:40.655630 run scp-back-log(pid=10467): Launched 04:50:41.732988 run scp-back-log(pid=10467): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10467)] 04:50:41.793568 run scp-back-log(pid=10467): stdout: | (launched: 2022-12-14_04:50:40.623749) 04:50:41.855740 run scp-back-log(pid=10467): stderr: | (launched: 2022-12-14_04:50:40.643500) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:50:41.926880 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10467): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10467)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 04:50:41.972304 tst iperf3_dl.py:13: Number of physical ue: 1 04:50:42.180670 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:50:42.224824 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 04:50:42.428777 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:50:42.444488 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:50:42.476247 tst iperf3_dl.py: using MSISDN 8520 04:50:42.588481 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8520', subscriber_id=0} 04:50:42.696017 run srsepc_10.42.42.118: Starting srsepc 04:50:43.328344 run rm-remote-dir(pid=10469): Launched 04:50:44.510557 run rm-remote-dir(pid=10469): Terminated: ok {rc=0} 04:50:44.849108 run mk-remote-dir(pid=10470): Launched 04:50:46.028650 run mk-remote-dir(pid=10470): Terminated: ok {rc=0} 04:50:46.328000 run scp-inst-to-remote(pid=10471): Launched 04:50:48.570065 run scp-inst-to-remote(pid=10471): Terminated: ok {rc=0} 04:50:48.930705 run rm-remote-dir(pid=10473): Launched 04:50:50.124121 run rm-remote-dir(pid=10473): Terminated: ok {rc=0} 04:50:50.486996 run mk-remote-dir(pid=10474): Launched 04:50:51.679080 run mk-remote-dir(pid=10474): Terminated: ok {rc=0} 04:50:51.989504 run scp-cfg-to-remote(pid=10477): Launched 04:50:53.169488 run scp-cfg-to-remote(pid=10477): Terminated: ok {rc=0} 04:50:53.456805 run scp-db-to-remote(pid=10479): Launched 04:50:54.639510 run scp-db-to-remote(pid=10479): Terminated: ok {rc=0} 04:50:54.781153 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:50:55.115161 run patchelf(pid=10481): Launched 04:50:56.306658 run patchelf(pid=10481): Terminated: ok {rc=0} 04:50:56.449693 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:50:56.783022 run setcap-netadm(pid=10482): Launched 04:50:57.967882 run setcap-netadm(pid=10482): Terminated: ok {rc=0} 04:50:58.294960 run srsepc(pid=10483): Launched 04:50:58.411868 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:50:59.532010 run rm-remote-dir(pid=10484): Launched 04:50:59.711752 run srsepc(pid=10483): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10483)] 04:50:59.849857 run srsepc(pid=10483): stdout: | (launched: 2022-12-14_04:50:58.237266) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:50:59.985974 run srsepc(pid=10483): stderr: | (launched: 2022-12-14_04:50:58.283240) | Connection to 10.42.42.116 closed. 04:51:00.122134 run srsepc(pid=10483): stdout: | (launched: 2022-12-14_04:50:58.237266) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:00.253480 run srsepc(pid=10483): stderr: | (launched: 2022-12-14_04:50:58.283240) | Connection to 10.42.42.116 closed. 04:51:00.408864 run rm-remote-dir(pid=10484): Terminating (SIGINT) 04:51:00.587985 run rm-remote-dir(pid=10484): Terminated: ok {rc=0} 04:51:00.717418 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=10483): Process ended prematurely: srsepc(pid=10483) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10483)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 04:51:00.727634 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 04:51:00.805979 run scp-back-log(pid=10485): Launched 04:51:01.906617 run scp-back-log(pid=10485): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10485)] 04:51:01.982144 run scp-back-log(pid=10485): stdout: | (launched: 2022-12-14_04:51:00.774031) 04:51:02.060506 run scp-back-log(pid=10485): stderr: | (launched: 2022-12-14_04:51:00.793828) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:02.147257 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10485): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10485)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 04:51:02.197025 tst iperf3_ul.py:13: Number of physical ue: 1 04:51:02.425519 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:02.469678 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 04:51:02.691581 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:02.708244 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:02.741297 tst iperf3_ul.py: using MSISDN 8521 04:51:02.855307 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8521', subscriber_id=0} 04:51:02.963565 run srsepc_10.42.42.118: Starting srsepc 04:51:03.597332 run rm-remote-dir(pid=10487): Launched 04:51:04.780197 run rm-remote-dir(pid=10487): Terminated: ok {rc=0} 04:51:05.120892 run mk-remote-dir(pid=10488): Launched 04:51:06.304365 run mk-remote-dir(pid=10488): Terminated: ok {rc=0} 04:51:06.595677 run scp-inst-to-remote(pid=10489): Launched 04:51:08.782593 run scp-inst-to-remote(pid=10489): Terminated: ok {rc=0} 04:51:09.144509 run rm-remote-dir(pid=10491): Launched 04:51:10.339423 run rm-remote-dir(pid=10491): Terminated: ok {rc=0} 04:51:10.704282 run mk-remote-dir(pid=10492): Launched 04:51:11.898270 run mk-remote-dir(pid=10492): Terminated: ok {rc=0} 04:51:12.208404 run scp-cfg-to-remote(pid=10493): Launched 04:51:13.400385 run scp-cfg-to-remote(pid=10493): Terminated: ok {rc=0} 04:51:13.708334 run scp-db-to-remote(pid=10495): Launched 04:51:14.899725 run scp-db-to-remote(pid=10495): Terminated: ok {rc=0} 04:51:15.041734 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:15.379416 run patchelf(pid=10497): Launched 04:51:16.571998 run patchelf(pid=10497): Terminated: ok {rc=0} 04:51:16.719388 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:17.064523 run setcap-netadm(pid=10498): Launched 04:51:18.288335 run setcap-netadm(pid=10498): Terminated: ok {rc=0} 04:51:18.642685 run srsepc(pid=10499): Launched 04:51:18.766907 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:19.964169 run rm-remote-dir(pid=10500): Launched 04:51:20.155414 run srsepc(pid=10499): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10499)] 04:51:20.300862 run srsepc(pid=10499): stdout: | (launched: 2022-12-14_04:51:18.580526) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:20.448035 run srsepc(pid=10499): stderr: | (launched: 2022-12-14_04:51:18.630533) | Connection to 10.42.42.116 closed. 04:51:20.593899 run srsepc(pid=10499): stdout: | (launched: 2022-12-14_04:51:18.580526) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:20.734461 run srsepc(pid=10499): stderr: | (launched: 2022-12-14_04:51:18.630533) | Connection to 10.42.42.116 closed. 04:51:20.901272 run rm-remote-dir(pid=10500): Terminating (SIGINT) 04:51:21.092493 run rm-remote-dir(pid=10500): Terminated: ok {rc=0} 04:51:21.230491 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=10499): Process ended prematurely: srsepc(pid=10499) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10499)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 04:51:21.241297 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 04:51:21.323836 run scp-back-log(pid=10501): Launched 04:51:22.405368 run scp-back-log(pid=10501): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10501)] 04:51:22.470269 run scp-back-log(pid=10501): stdout: | (launched: 2022-12-14_04:51:21.290872) 04:51:22.536306 run scp-back-log(pid=10501): stderr: | (launched: 2022-12-14_04:51:21.311529) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:22.610806 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10501): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10501)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 04:51:22.659155 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:22.676635 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:22.700908 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:22.753437 tst ping.py: using MSISDN 8522 04:51:22.879102 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8522', subscriber_id=0} 04:51:22.995885 run srsepc_10.42.42.118: Starting srsepc 04:51:23.681728 run rm-remote-dir(pid=10503): Launched 04:51:24.864578 run rm-remote-dir(pid=10503): Terminated: ok {rc=0} 04:51:25.205046 run mk-remote-dir(pid=10504): Launched 04:51:26.386301 run mk-remote-dir(pid=10504): Terminated: ok {rc=0} 04:51:26.677389 run scp-inst-to-remote(pid=10505): Launched 04:51:28.862321 run scp-inst-to-remote(pid=10505): Terminated: ok {rc=0} 04:51:29.223470 run rm-remote-dir(pid=10507): Launched 04:51:30.417426 run rm-remote-dir(pid=10507): Terminated: ok {rc=0} 04:51:30.780471 run mk-remote-dir(pid=10508): Launched 04:51:31.986767 run mk-remote-dir(pid=10508): Terminated: ok {rc=0} 04:51:32.304703 run scp-cfg-to-remote(pid=10509): Launched 04:51:33.506973 run scp-cfg-to-remote(pid=10509): Terminated: ok {rc=0} 04:51:33.813967 run scp-db-to-remote(pid=10511): Launched 04:51:35.002917 run scp-db-to-remote(pid=10511): Terminated: ok {rc=0} 04:51:35.144573 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:35.478428 run patchelf(pid=10513): Launched 04:51:36.667863 run patchelf(pid=10513): Terminated: ok {rc=0} 04:51:36.809116 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:37.141945 run setcap-netadm(pid=10514): Launched 04:51:38.331405 run setcap-netadm(pid=10514): Terminated: ok {rc=0} 04:51:38.681569 run srsepc(pid=10515): Launched 04:51:38.805330 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:39.938143 run rm-remote-dir(pid=10516): Launched 04:51:40.118891 run srsepc(pid=10515): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10515)] 04:51:40.256015 run srsepc(pid=10515): stdout: | (launched: 2022-12-14_04:51:38.619933) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:40.391661 run srsepc(pid=10515): stderr: | (launched: 2022-12-14_04:51:38.669252) | Connection to 10.42.42.116 closed. 04:51:40.527617 run srsepc(pid=10515): stdout: | (launched: 2022-12-14_04:51:38.619933) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:51:40.658611 run srsepc(pid=10515): stderr: | (launched: 2022-12-14_04:51:38.669252) | Connection to 10.42.42.116 closed. 04:51:40.812858 run rm-remote-dir(pid=10516): Terminating (SIGINT) 04:51:40.992196 run rm-remote-dir(pid=10516): Terminated: ok {rc=0} 04:51:41.122129 tst ping.py:16: ERR: Error: srsepc(pid=10515): Process ended prematurely: srsepc(pid=10515) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10515)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 04:51:41.132439 tst ping.py:16: Test FAILED (18.5 sec) 04:51:41.210642 run scp-back-log(pid=10517): Launched 04:51:42.289935 run scp-back-log(pid=10517): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10517)] 04:51:42.350496 run scp-back-log(pid=10517): stdout: | (launched: 2022-12-14_04:51:41.179009) 04:51:42.412315 run scp-back-log(pid=10517): stderr: | (launched: 2022-12-14_04:51:41.198742) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:51:42.481703 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10517): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10517)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 04:51:42.527234 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:51:42.543861 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:51:42.566460 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:51:42.617516 tst rrc_idle_mo_ping.py: using MSISDN 8523 04:51:42.734358 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8523', subscriber_id=0} 04:51:42.843359 run srsepc_10.42.42.118: Starting srsepc 04:51:43.477245 run rm-remote-dir(pid=10519): Launched 04:51:44.659267 run rm-remote-dir(pid=10519): Terminated: ok {rc=0} 04:51:44.999272 run mk-remote-dir(pid=10520): Launched 04:51:46.205799 run mk-remote-dir(pid=10520): Terminated: ok {rc=0} 04:51:46.517612 run scp-inst-to-remote(pid=10521): Launched 04:51:48.759476 run scp-inst-to-remote(pid=10521): Terminated: ok {rc=0} 04:51:49.097891 run rm-remote-dir(pid=10523): Launched 04:51:50.279570 run rm-remote-dir(pid=10523): Terminated: ok {rc=0} 04:51:50.619698 run mk-remote-dir(pid=10524): Launched 04:51:51.802493 run mk-remote-dir(pid=10524): Terminated: ok {rc=0} 04:51:52.091668 run scp-cfg-to-remote(pid=10525): Launched 04:51:53.274181 run scp-cfg-to-remote(pid=10525): Terminated: ok {rc=0} 04:51:53.583318 run scp-db-to-remote(pid=10527): Launched 04:51:54.773868 run scp-db-to-remote(pid=10527): Terminated: ok {rc=0} 04:51:54.915798 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:51:55.249922 run patchelf(pid=10529): Launched 04:51:56.440307 run patchelf(pid=10529): Terminated: ok {rc=0} 04:51:56.583392 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:51:56.918556 run setcap-netadm(pid=10530): Launched 04:51:58.109226 run setcap-netadm(pid=10530): Terminated: ok {rc=0} 04:51:58.459426 run srsepc(pid=10531): Launched 04:51:58.583566 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:51:59.775024 run rm-remote-dir(pid=10532): Launched 04:51:59.964464 run srsepc(pid=10531): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10531)] 04:52:00.109380 run srsepc(pid=10531): stdout: | (launched: 2022-12-14_04:51:58.397995) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:00.254816 run srsepc(pid=10531): stderr: | (launched: 2022-12-14_04:51:58.447437) | Connection to 10.42.42.116 closed. 04:52:00.400389 run srsepc(pid=10531): stdout: | (launched: 2022-12-14_04:51:58.397995) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:00.539991 run srsepc(pid=10531): stderr: | (launched: 2022-12-14_04:51:58.447437) | Connection to 10.42.42.116 closed. 04:52:00.705640 run rm-remote-dir(pid=10532): Terminating (SIGINT) 04:52:00.898062 run rm-remote-dir(pid=10532): Terminated: ok {rc=0} 04:52:01.039109 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=10531): Process ended prematurely: srsepc(pid=10531) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10531)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 04:52:01.050996 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 04:52:01.135986 run scp-back-log(pid=10533): Launched 04:52:02.238584 run scp-back-log(pid=10533): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10533)] 04:52:02.309083 run scp-back-log(pid=10533): stdout: | (launched: 2022-12-14_04:52:01.103603) 04:52:02.376473 run scp-back-log(pid=10533): stderr: | (launched: 2022-12-14_04:52:01.124629) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:52:02.451305 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10533): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10533)]') ---------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 04:52:02.499554 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 04:52:02.518058 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 04:52:02.542668 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 04:52:02.600885 tst rrc_idle_mt_ping.py: using MSISDN 8524 04:52:02.724167 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8524', subscriber_id=0} 04:52:02.840796 run srsepc_10.42.42.118: Starting srsepc 04:52:03.518242 run rm-remote-dir(pid=10535): Launched 04:52:04.710204 run rm-remote-dir(pid=10535): Terminated: ok {rc=0} 04:52:05.072215 run mk-remote-dir(pid=10536): Launched 04:52:06.263833 run mk-remote-dir(pid=10536): Terminated: ok {rc=0} 04:52:06.572477 run scp-inst-to-remote(pid=10537): Launched 04:52:08.761882 run scp-inst-to-remote(pid=10537): Terminated: ok {rc=0} 04:52:09.099799 run rm-remote-dir(pid=10539): Launched 04:52:10.280694 run rm-remote-dir(pid=10539): Terminated: ok {rc=0} 04:52:10.619842 run mk-remote-dir(pid=10540): Launched 04:52:11.801676 run mk-remote-dir(pid=10540): Terminated: ok {rc=0} 04:52:12.090941 run scp-cfg-to-remote(pid=10541): Launched 04:52:13.269997 run scp-cfg-to-remote(pid=10541): Terminated: ok {rc=0} 04:52:13.556850 run scp-db-to-remote(pid=10543): Launched 04:52:14.736247 run scp-db-to-remote(pid=10543): Terminated: ok {rc=0} 04:52:14.868621 run srsepc_10.42.42.118: Setting RPATH for srsepc 04:52:15.180546 run patchelf(pid=10545): Launched 04:52:16.369209 run patchelf(pid=10545): Terminated: ok {rc=0} 04:52:16.505969 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 04:52:16.830260 run setcap-netadm(pid=10546): Launched 04:52:18.067747 run setcap-netadm(pid=10546): Terminated: ok {rc=0} 04:52:18.395989 run srsepc(pid=10547): Launched 04:52:18.525300 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 04:52:19.721384 run rm-remote-dir(pid=10548): Launched 04:52:19.910730 run srsepc(pid=10547): ERR: Terminated: ERROR {rc=127} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10547)] 04:52:20.056103 run srsepc(pid=10547): stdout: | (launched: 2022-12-14_04:52:18.337065) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:20.202378 run srsepc(pid=10547): stderr: | (launched: 2022-12-14_04:52:18.383825) | Connection to 10.42.42.116 closed. 04:52:20.348250 run srsepc(pid=10547): stdout: | (launched: 2022-12-14_04:52:18.337065) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 04:52:20.488797 run srsepc(pid=10547): stderr: | (launched: 2022-12-14_04:52:18.383825) | Connection to 10.42.42.116 closed. 04:52:20.655395 run rm-remote-dir(pid=10548): Terminating (SIGINT) 04:52:20.846659 run rm-remote-dir(pid=10548): Terminated: ok {rc=0} 04:52:20.985447 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=10547): Process ended prematurely: srsepc(pid=10547) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10547)] [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 04:52:20.996347 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 04:52:21.079593 run scp-back-log(pid=10549): Launched 04:52:22.162442 run scp-back-log(pid=10549): ERR: Terminated: ERROR {rc=1} [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10549)] 04:52:22.227124 run scp-back-log(pid=10549): stdout: | (launched: 2022-12-14_04:52:21.046373) 04:52:22.293532 run scp-back-log(pid=10549): stderr: | (launched: 2022-12-14_04:52:21.067276) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 04:52:22.368056 tst srsepc_10.42.42.118: Error('scp-back-log(pid=10549): launch_sync(): local process exited with status 1 [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=10549)]') --------------------------------------------------------------------- trial-2399 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 04:52:22.503090 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:22.509181 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 04:52:22.552432 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 04:52:22.579937 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 04:52:22.633160 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 04:52:22.677320 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 04:52:22.704553 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 04:52:23.254618 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 04:52:23.260325 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:23.271688 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:52:23.311722 tst handover.py: using LAC 38663 04:52:23.443195 tst handover.py: using RAC 158 04:52:23.572374 tst handover.py: using CellId 38663 04:52:23.702103 tst handover.py: using BVCI 38664 04:52:23.822541 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 04:52:23.858444 tst handover.py: using LAC 38664 04:52:23.988636 tst handover.py: using RAC 159 04:52:24.116801 tst handover.py: using CellId 38664 04:52:24.246810 tst handover.py: using BVCI 38665 04:52:24.367315 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:24.378690 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:24.389818 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:24.401443 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:24.412802 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 04:52:24.424210 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:52:24.542321 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 04:52:24.662798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:25.169649 run create_hlr_db(pid=10556): Launched 04:52:26.360932 run create_hlr_db(pid=10556): Terminated: ok {rc=0} 04:52:26.706608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Launched 04:52:27.033899 run osmo-hlr_10.42.42.2(pid=10559): Launched 04:52:27.158442 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:27.719343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Launched 04:52:28.046052 run osmo-stp_10.42.42.5(pid=10562): Launched 04:52:28.170430 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:28.760725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10564): Launched 04:52:29.089570 run osmo-msc_10.42.42.6(pid=10565): Launched 04:52:29.272309 run osmo-stp_10.42.42.5(pid=10562): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] 04:52:29.411059 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-14_04:52:27.985144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:29.550123 run osmo-stp_10.42.42.5(pid=10562): stderr: | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045228180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:29.687472 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-14_04:52:27.985144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:29.817049 run osmo-stp_10.42.42.5(pid=10562): stderr: | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045228179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045228180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045228180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:29.972157 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 04:52:29.980911 tst handover.py:18: Test FAILED (6.7 sec) 04:52:30.008395 run osmo-hlr_10.42.42.2(pid=10559): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10559)] 04:52:30.058346 run osmo-hlr_10.42.42.2(pid=10559): stdout: | (launched: 2022-12-14_04:52:26.972810) 04:52:30.110114 run osmo-hlr_10.42.42.2(pid=10559): stderr: | [0;m[1;31m20221214045227172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045227173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045227173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045227173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045227173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045227173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045227185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045227193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045227193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045227193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:30.182649 run osmo-msc_10.42.42.6(pid=10565): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10565)] 04:52:30.232769 run osmo-msc_10.42.42.6(pid=10565): stdout: | (launched: 2022-12-14_04:52:29.028833) 04:52:30.284555 run osmo-msc_10.42.42.6(pid=10565): stderr: | [0;m[38;5;43m20221214045229350 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045229351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4c5923fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045229351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045229351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045229351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045229351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045229353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045229353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045229353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045229353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:30.336495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminating (SIGTERM) 04:52:30.378355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminating (SIGTERM) 04:52:30.420283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10564): Terminating (SIGTERM) 04:52:30.462329 --- ParallelTerminationStrategy: PID 10558 died... 04:52:30.482272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminated: ok {rc=0} 04:52:30.528560 --- ParallelTerminationStrategy: PID 10561 died... 04:52:30.548129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminated: ok {rc=0} 04:52:30.594036 --- ParallelTerminationStrategy: PID 10564 died... 04:52:30.613576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10564): Terminated: ok {rc=0} 04:52:30.701663 bus /sierra_3: Setting Powered False 04:52:31.804172 bus /sierra_3: Setting Powered False 04:52:32.933639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 04:52:34.184321 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:34.189892 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:52:34.230867 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:52:34.258426 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:52:34.311235 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:52:34.352179 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:52:34.379106 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:52:34.930785 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 04:52:34.936034 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:34.947070 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:34.983337 tst handover.py: using LAC 38665 04:52:35.104005 tst handover.py: using RAC 160 04:52:35.223632 tst handover.py: using CellId 38665 04:52:35.348458 tst handover.py: using BVCI 38666 04:52:35.469024 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 04:52:35.503768 tst handover.py: using LAC 38666 04:52:35.623921 tst handover.py: using RAC 161 04:52:35.741923 tst handover.py: using CellId 38666 04:52:35.862040 tst handover.py: using BVCI 38667 04:52:35.972595 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:35.983460 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:35.994089 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:36.004667 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:36.015657 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:52:36.026707 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:36.147807 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 04:52:36.264308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:36.712653 run create_hlr_db(pid=10571): Launched 04:52:36.828491 bus /sierra_2: Setting Powered False 04:52:37.889179 run create_hlr_db(pid=10571): Terminated: ok {rc=0} 04:52:38.308738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10573): Launched 04:52:38.638828 run osmo-hlr_10.42.42.2(pid=10574): Launched 04:52:38.763622 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:39.308090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10576): Launched 04:52:39.638260 run osmo-stp_10.42.42.5(pid=10577): Launched 04:52:39.763760 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:40.328051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10579): Launched 04:52:40.658550 run osmo-msc_10.42.42.6(pid=10580): Launched 04:52:40.841787 run osmo-stp_10.42.42.5(pid=10577): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10577)] 04:52:40.981324 run osmo-stp_10.42.42.5(pid=10577): stdout: | (launched: 2022-12-14_04:52:39.577468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:41.119881 run osmo-stp_10.42.42.5(pid=10577): stderr: | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045239775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:41.256794 run osmo-stp_10.42.42.5(pid=10577): stdout: | (launched: 2022-12-14_04:52:39.577468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:41.387148 run osmo-stp_10.42.42.5(pid=10577): stderr: | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045239774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045239775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045239775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:41.543279 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10577): Process ended prematurely: osmo-stp_10.42.42.5(pid=10577) [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10577)] [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 04:52:41.552395 tst handover.py:18: Test FAILED (6.6 sec) 04:52:41.580049 run osmo-hlr_10.42.42.2(pid=10574): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10574)] 04:52:41.629892 run osmo-hlr_10.42.42.2(pid=10574): stdout: | (launched: 2022-12-14_04:52:38.577884) 04:52:41.681711 run osmo-hlr_10.42.42.2(pid=10574): stderr: | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045238777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045238790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045238798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045238798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045238798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:41.754053 run osmo-msc_10.42.42.6(pid=10580): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10580)] 04:52:41.803760 run osmo-msc_10.42.42.6(pid=10580): stdout: | (launched: 2022-12-14_04:52:40.597912) 04:52:41.855019 run osmo-msc_10.42.42.6(pid=10580): stderr: | [0;m[38;5;43m20221214045240921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045240921 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f104a040c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045240921 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045240921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045240921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045240921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045240923 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045240923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045240924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045240924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:41.906846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10573): Terminating (SIGTERM) 04:52:41.948353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10576): Terminating (SIGTERM) 04:52:41.989825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10579): Terminating (SIGTERM) 04:52:42.032048 --- ParallelTerminationStrategy: PID 10573 died... 04:52:42.052024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10573): Terminated: ok {rc=0} 04:52:42.098493 --- ParallelTerminationStrategy: PID 10576 died... 04:52:42.117902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10576): Terminated: ok {rc=0} 04:52:42.163484 --- ParallelTerminationStrategy: PID 10579 died... 04:52:42.182894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10579): Terminated: ok {rc=0} 04:52:42.270519 bus /sierra_3: Setting Powered False 04:52:43.369522 bus /sierra_3: Setting Powered False 04:52:44.484466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 04:52:45.729311 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:45.734455 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:52:45.787873 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:52:45.814111 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:52:45.878753 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:52:45.943064 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:52:45.970616 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:52:46.533877 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 04:52:46.539072 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:46.552505 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:52:46.597768 tst handover.py: using LAC 38667 04:52:46.717531 tst handover.py: using RAC 162 04:52:46.838387 tst handover.py: using CellId 38667 04:52:47.010192 tst handover.py: using BVCI 38668 04:52:47.133534 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:52:47.183493 tst handover.py: using LAC 38668 04:52:47.313333 tst handover.py: using RAC 163 04:52:47.442324 tst handover.py: using CellId 38668 04:52:47.570622 tst handover.py: using BVCI 38669 04:52:47.689397 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:47.700599 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:47.711734 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:47.722769 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:47.734456 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:52:47.746020 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:52:47.863431 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:52:47.983317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:52:48.463164 run create_hlr_db(pid=10585): Launched 04:52:48.595089 bus /sierra_2: Setting Powered False 04:52:49.659445 run create_hlr_db(pid=10585): Terminated: ok {rc=0} 04:52:50.070119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10587): Launched 04:52:50.376724 run osmo-hlr_10.42.42.2(pid=10588): Launched 04:52:50.493826 run osmo-stp_10.42.42.5: Starting osmo-stp 04:52:51.000210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10590): Launched 04:52:51.308257 run osmo-stp_10.42.42.5(pid=10591): Launched 04:52:51.425145 run osmo-msc_10.42.42.6: Starting osmo-msc 04:52:51.982733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10593): Launched 04:52:52.311016 run osmo-msc_10.42.42.6(pid=10594): Launched 04:52:52.495286 run osmo-stp_10.42.42.5(pid=10591): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10591)] 04:52:52.633459 run osmo-stp_10.42.42.5(pid=10591): stdout: | (launched: 2022-12-14_04:52:51.250682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:52.771197 run osmo-stp_10.42.42.5(pid=10591): stderr: | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045251423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:52.908037 run osmo-stp_10.42.42.5(pid=10591): stdout: | (launched: 2022-12-14_04:52:51.250682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:52:53.037805 run osmo-stp_10.42.42.5(pid=10591): stderr: | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045251422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045251423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045251423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:52:53.193305 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10591): Process ended prematurely: osmo-stp_10.42.42.5(pid=10591) [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10591)] [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 04:52:53.202443 tst handover.py:18: Test FAILED (6.7 sec) 04:52:53.229841 run osmo-hlr_10.42.42.2(pid=10588): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10588)] 04:52:53.279900 run osmo-hlr_10.42.42.2(pid=10588): stdout: | (launched: 2022-12-14_04:52:50.319622) 04:52:53.331685 run osmo-hlr_10.42.42.2(pid=10588): stderr: | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045250495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045250508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045250518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045250518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045250518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:52:53.403906 run osmo-msc_10.42.42.6(pid=10594): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10594)] 04:52:53.454095 run osmo-msc_10.42.42.6(pid=10594): stdout: | (launched: 2022-12-14_04:52:52.250450) 04:52:53.505782 run osmo-msc_10.42.42.6(pid=10594): stderr: | [0;m[38;5;43m20221214045252572 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045252572 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b50170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045252573 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045252573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045252573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045252573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045252575 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045252575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045252575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045252575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:52:53.557757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10587): Terminating (SIGTERM) 04:52:53.599180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10590): Terminating (SIGTERM) 04:52:53.640724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10593): Terminating (SIGTERM) 04:52:53.682694 --- ParallelTerminationStrategy: PID 10587 died... 04:52:53.702816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10587): Terminated: ok {rc=0} 04:52:53.749347 --- ParallelTerminationStrategy: PID 10590 died... 04:52:53.768930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10590): Terminated: ok {rc=0} 04:52:53.815519 --- ParallelTerminationStrategy: PID 10593 died... 04:52:53.835137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10593): Terminated: ok {rc=0} 04:52:53.923647 bus /sierra_3: Setting Powered False 04:52:55.022818 bus /sierra_3: Setting Powered False 04:52:56.142324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:52:57.408418 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:52:57.414502 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:52:57.467676 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:52:57.494174 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:52:57.547744 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:52:57.600229 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:52:57.627321 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:52:58.173784 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:52:58.180232 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:58.191949 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:52:58.229759 tst handover.py: using LAC 38669 04:52:58.359861 tst handover.py: using RAC 164 04:52:58.488473 tst handover.py: using CellId 38669 04:52:58.629370 tst handover.py: using BVCI 38670 04:52:58.749843 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:52:58.800729 tst handover.py: using LAC 38670 04:52:58.928525 tst handover.py: using RAC 165 04:52:59.054523 tst handover.py: using CellId 38670 04:52:59.180419 tst handover.py: using BVCI 38671 04:52:59.299426 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:59.311228 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:59.322622 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:59.333961 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:59.350618 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:52:59.362798 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:52:59.479976 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:52:59.595987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:00.044281 run create_hlr_db(pid=10599): Launched 04:53:00.161407 bus /sierra_2: Setting Powered False 04:53:01.223421 run create_hlr_db(pid=10599): Terminated: ok {rc=0} 04:53:01.641833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10601): Launched 04:53:01.963795 run osmo-hlr_10.42.42.2(pid=10602): Launched 04:53:02.188388 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:02.726941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10604): Launched 04:53:03.053751 run osmo-stp_10.42.42.5(pid=10605): Launched 04:53:03.179277 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:03.748803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10607): Launched 04:53:04.076616 run osmo-msc_10.42.42.6(pid=10608): Launched 04:53:04.258105 run osmo-stp_10.42.42.5(pid=10605): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10605)] 04:53:04.396095 run osmo-stp_10.42.42.5(pid=10605): stdout: | (launched: 2022-12-14_04:53:02.992855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:04.535659 run osmo-stp_10.42.42.5(pid=10605): stderr: | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045303188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:04.672831 run osmo-stp_10.42.42.5(pid=10605): stdout: | (launched: 2022-12-14_04:53:02.992855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:04.802641 run osmo-stp_10.42.42.5(pid=10605): stderr: | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045303188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045303188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045303189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:04.957865 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10605): Process ended prematurely: osmo-stp_10.42.42.5(pid=10605) [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10605)] [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 04:53:04.966880 tst handover.py:18: Test FAILED (6.8 sec) 04:53:04.994346 run osmo-hlr_10.42.42.2(pid=10602): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10602)] 04:53:05.044340 run osmo-hlr_10.42.42.2(pid=10602): stdout: | (launched: 2022-12-14_04:53:01.902253) 04:53:05.095988 run osmo-hlr_10.42.42.2(pid=10602): stderr: | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045302219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045302276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045302285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045302285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045302285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:05.167975 run osmo-msc_10.42.42.6(pid=10608): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10608)] 04:53:05.217848 run osmo-msc_10.42.42.6(pid=10608): stdout: | (launched: 2022-12-14_04:53:04.015908) 04:53:05.270001 run osmo-msc_10.42.42.6(pid=10608): stderr: | [0;m[38;5;43m20221214045304338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045304338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2311d6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045304338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045304338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045304338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045304339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045304340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045304341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045304341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045304341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:05.321975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10601): Terminating (SIGTERM) 04:53:05.363538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10604): Terminating (SIGTERM) 04:53:05.405388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10607): Terminating (SIGTERM) 04:53:05.448065 --- ParallelTerminationStrategy: PID 10601 died... 04:53:05.468182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10601): Terminated: ok {rc=0} 04:53:05.514747 --- ParallelTerminationStrategy: PID 10604 died... 04:53:05.534339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10604): Terminated: ok {rc=0} 04:53:05.580109 --- ParallelTerminationStrategy: PID 10607 died... 04:53:05.599645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10607): Terminated: ok {rc=0} 04:53:05.687073 bus /sierra_3: Setting Powered False 04:53:06.782575 bus /sierra_3: Setting Powered False 04:53:07.900016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:53:09.162712 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:09.168448 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:53:09.224007 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:53:09.251367 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:53:09.306655 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:53:09.362017 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:53:09.389042 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:53:09.937544 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:53:09.943034 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:09.954332 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:09.992068 tst handover.py: using LAC 38671 04:53:10.114227 tst handover.py: using RAC 166 04:53:10.244474 tst handover.py: using CellId 38671 04:53:10.372901 tst handover.py: using BVCI 38672 04:53:10.493239 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:53:10.545176 tst handover.py: using LAC 38672 04:53:10.675442 tst handover.py: using RAC 167 04:53:10.805762 tst handover.py: using CellId 38672 04:53:10.935462 tst handover.py: using BVCI 38673 04:53:11.056410 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:11.067830 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:11.079060 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:11.090386 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:11.102190 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:53:11.113926 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:11.233008 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:53:11.354358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:11.834960 run create_hlr_db(pid=10613): Launched 04:53:11.968762 bus /sierra_2: Setting Powered False 04:53:13.033503 run create_hlr_db(pid=10613): Terminated: ok {rc=0} 04:53:13.461936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10615): Launched 04:53:13.788272 run osmo-hlr_10.42.42.2(pid=10616): Launched 04:53:13.912190 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:14.448759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10618): Launched 04:53:14.777574 run osmo-stp_10.42.42.5(pid=10619): Launched 04:53:14.902398 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:15.467959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10621): Launched 04:53:15.797885 run osmo-msc_10.42.42.6(pid=10622): Launched 04:53:16.103968 run osmo-stp_10.42.42.5(pid=10619): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10619)] 04:53:16.412915 run osmo-stp_10.42.42.5(pid=10619): stdout: | (launched: 2022-12-14_04:53:14.717092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:16.651607 run osmo-stp_10.42.42.5(pid=10619): stderr: | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045314912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045314912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045314912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045314913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:16.785195 run osmo-stp_10.42.42.5(pid=10619): stdout: | (launched: 2022-12-14_04:53:14.717092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:16.912215 run osmo-stp_10.42.42.5(pid=10619): stderr: | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045314911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045314912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045314912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045314912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045314913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:17.063503 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10619): Process ended prematurely: osmo-stp_10.42.42.5(pid=10619) [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10619)] [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 04:53:17.072890 tst handover.py:18: Test FAILED (7.1 sec) 04:53:17.101679 run osmo-hlr_10.42.42.2(pid=10616): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10616)] 04:53:17.153826 run osmo-hlr_10.42.42.2(pid=10616): stdout: | (launched: 2022-12-14_04:53:13.727477) 04:53:17.205929 run osmo-hlr_10.42.42.2(pid=10616): stderr: | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045313926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045313939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045313947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045313947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045313947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:17.279255 run osmo-msc_10.42.42.6(pid=10622): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10622)] 04:53:17.327909 run osmo-msc_10.42.42.6(pid=10622): stdout: | (launched: 2022-12-14_04:53:15.736734) 04:53:17.382530 run osmo-msc_10.42.42.6(pid=10622): stderr: | [0;m[38;5;43m20221214045316192 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045316192 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec36207c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045316192 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045316192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045316193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045316193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045316194 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045316195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045316195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045316195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:17.435143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10615): Terminating (SIGTERM) 04:53:17.477162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10618): Terminating (SIGTERM) 04:53:17.518982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10621): Terminating (SIGTERM) 04:53:17.560813 --- ParallelTerminationStrategy: PID 10615 died... 04:53:17.581005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10615): Terminated: ok {rc=0} 04:53:17.627081 --- ParallelTerminationStrategy: PID 10618 died... 04:53:17.646852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10618): Terminated: ok {rc=0} 04:53:17.692782 --- ParallelTerminationStrategy: PID 10621 died... 04:53:17.712931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10621): Terminated: ok {rc=0} 04:53:17.801282 bus /sierra_3: Setting Powered False 04:53:18.898999 bus /sierra_3: Setting Powered False 04:53:20.014532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 04:53:21.282018 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:21.288281 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:53:21.330690 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:53:21.357660 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:53:21.410593 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:53:21.453711 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:53:21.480919 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:53:22.027228 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 04:53:22.032743 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:22.043731 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:22.081602 tst handover.py: using LAC 38673 04:53:22.205805 tst handover.py: using RAC 168 04:53:22.337625 tst handover.py: using CellId 38673 04:53:22.467296 tst handover.py: using BVCI 38674 04:53:22.587765 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 04:53:22.624431 tst handover.py: using LAC 38674 04:53:22.749446 tst handover.py: using RAC 169 04:53:22.878901 tst handover.py: using CellId 38674 04:53:23.005834 tst handover.py: using BVCI 38675 04:53:23.119912 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:23.130910 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:23.141785 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:23.152490 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:23.164259 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:53:23.175972 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:23.299314 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 04:53:23.417729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:23.868732 run create_hlr_db(pid=10627): Launched 04:53:23.985548 bus /sierra_2: Setting Powered False 04:53:25.046045 run create_hlr_db(pid=10627): Terminated: ok {rc=0} 04:53:25.466801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Launched 04:53:25.794626 run osmo-hlr_10.42.42.2(pid=10630): Launched 04:53:25.938687 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:26.479997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Launched 04:53:26.808084 run osmo-stp_10.42.42.5(pid=10633): Launched 04:53:26.932529 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:27.496843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10635): Launched 04:53:27.825456 run osmo-msc_10.42.42.6(pid=10636): Launched 04:53:28.007506 run osmo-stp_10.42.42.5(pid=10633): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] 04:53:28.145444 run osmo-stp_10.42.42.5(pid=10633): stdout: | (launched: 2022-12-14_04:53:26.747652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:28.283774 run osmo-stp_10.42.42.5(pid=10633): stderr: | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045326943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:28.421518 run osmo-stp_10.42.42.5(pid=10633): stdout: | (launched: 2022-12-14_04:53:26.747652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:28.552417 run osmo-stp_10.42.42.5(pid=10633): stderr: | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045326942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045326943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045326943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:28.708631 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10633): Process ended prematurely: osmo-stp_10.42.42.5(pid=10633) [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 04:53:28.717775 tst handover.py:18: Test FAILED (6.7 sec) 04:53:28.745477 run osmo-hlr_10.42.42.2(pid=10630): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10630)] 04:53:28.795491 run osmo-hlr_10.42.42.2(pid=10630): stdout: | (launched: 2022-12-14_04:53:25.733598) 04:53:28.847062 run osmo-hlr_10.42.42.2(pid=10630): stderr: | [0;m[1;31m20221214045325944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045325944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045325944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045325944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045325945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045325945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045325957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045325967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045325967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045325967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:28.919223 run osmo-msc_10.42.42.6(pid=10636): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10636)] 04:53:28.969622 run osmo-msc_10.42.42.6(pid=10636): stdout: | (launched: 2022-12-14_04:53:27.764751) 04:53:29.021234 run osmo-msc_10.42.42.6(pid=10636): stderr: | [0;m[38;5;43m20221214045328086 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045328086 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7facb5373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045328086 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045328087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045328087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045328087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045328088 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045328089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045328089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045328089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:29.073331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Terminating (SIGTERM) 04:53:29.115024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Terminating (SIGTERM) 04:53:29.156315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10635): Terminating (SIGTERM) 04:53:29.198410 --- ParallelTerminationStrategy: PID 10629 died... 04:53:29.218332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10629): Terminated: ok {rc=0} 04:53:29.264439 --- ParallelTerminationStrategy: PID 10632 died... 04:53:29.284119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10632): Terminated: ok {rc=0} 04:53:29.330489 --- ParallelTerminationStrategy: PID 10635 died... 04:53:29.350283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10635): Terminated: ok {rc=0} 04:53:29.439121 bus /sierra_3: Setting Powered False 04:53:30.540585 bus /sierra_3: Setting Powered False 04:53:31.657964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 04:53:32.915387 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:32.921225 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:53:32.976210 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:53:33.003616 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:53:33.057481 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:53:33.110380 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:53:33.136678 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:53:33.691016 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 04:53:33.696741 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:33.708041 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:33.750821 tst handover.py: using LAC 38675 04:53:33.870491 tst handover.py: using RAC 170 04:53:33.992048 tst handover.py: using CellId 38675 04:53:34.109937 tst handover.py: using BVCI 38676 04:53:34.222714 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:53:34.269127 tst handover.py: using LAC 38676 04:53:34.386388 tst handover.py: using RAC 171 04:53:34.506510 tst handover.py: using CellId 38676 04:53:34.626880 tst handover.py: using BVCI 38677 04:53:34.739251 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:34.750108 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:34.760924 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:34.771760 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:34.782778 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:53:34.793997 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:34.910041 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:53:35.024128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:35.473177 run create_hlr_db(pid=10641): Launched 04:53:35.589558 bus /sierra_2: Setting Powered False 04:53:36.650499 run create_hlr_db(pid=10641): Terminated: ok {rc=0} 04:53:37.052494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10643): Launched 04:53:37.360596 run osmo-hlr_10.42.42.2(pid=10644): Launched 04:53:37.478022 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:37.985960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10646): Launched 04:53:38.292601 run osmo-stp_10.42.42.5(pid=10647): Launched 04:53:38.410066 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:38.939220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10649): Launched 04:53:39.247398 run osmo-msc_10.42.42.6(pid=10650): Launched 04:53:39.418770 run osmo-stp_10.42.42.5(pid=10647): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] 04:53:39.548516 run osmo-stp_10.42.42.5(pid=10647): stdout: | (launched: 2022-12-14_04:53:38.234799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:39.677966 run osmo-stp_10.42.42.5(pid=10647): stderr: | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045338408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:39.805370 run osmo-stp_10.42.42.5(pid=10647): stdout: | (launched: 2022-12-14_04:53:38.234799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:39.926851 run osmo-stp_10.42.42.5(pid=10647): stderr: | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045338407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045338408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045338408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:40.072290 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10647): Process ended prematurely: osmo-stp_10.42.42.5(pid=10647) [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 04:53:40.080804 tst handover.py:18: Test FAILED (6.4 sec) 04:53:40.106957 run osmo-hlr_10.42.42.2(pid=10644): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10644)] 04:53:40.155643 run osmo-hlr_10.42.42.2(pid=10644): stdout: | (launched: 2022-12-14_04:53:37.302807) 04:53:40.205353 run osmo-hlr_10.42.42.2(pid=10644): stderr: | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045337479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045337491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045337500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045337500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045337500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:40.274910 run osmo-msc_10.42.42.6(pid=10650): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10650)] 04:53:40.322607 run osmo-msc_10.42.42.6(pid=10650): stdout: | (launched: 2022-12-14_04:53:39.190324) 04:53:40.372144 run osmo-msc_10.42.42.6(pid=10650): stderr: | [0;m[38;5;43m20221214045339463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045339463 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f37248aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045339463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045339463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045339463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045339464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045339465 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045339466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045339466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045339466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:40.421945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10643): Terminating (SIGTERM) 04:53:40.461870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10646): Terminating (SIGTERM) 04:53:40.501504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10649): Terminating (SIGTERM) 04:53:40.541254 --- ParallelTerminationStrategy: PID 10643 died... 04:53:40.560493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10643): Terminated: ok {rc=0} 04:53:40.604315 --- ParallelTerminationStrategy: PID 10646 died... 04:53:40.623345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10646): Terminated: ok {rc=0} 04:53:40.666893 --- ParallelTerminationStrategy: PID 10649 died... 04:53:40.685770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10649): Terminated: ok {rc=0} 04:53:40.771140 bus /sierra_3: Setting Powered False 04:53:41.870082 bus /sierra_3: Setting Powered False 04:53:42.985359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 04:53:44.244367 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:44.249522 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:53:44.302692 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:53:44.328737 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:53:44.379656 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:53:44.431890 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:53:44.458310 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:53:45.009528 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 04:53:45.014952 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:45.026147 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:53:45.064848 tst handover.py: using LAC 38677 04:53:45.186232 tst handover.py: using RAC 172 04:53:45.309690 tst handover.py: using CellId 38677 04:53:45.438666 tst handover.py: using BVCI 38678 04:53:45.557950 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:53:45.607553 tst handover.py: using LAC 38678 04:53:45.728828 tst handover.py: using RAC 173 04:53:45.857602 tst handover.py: using CellId 38678 04:53:45.999276 tst handover.py: using BVCI 38679 04:53:46.114897 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:46.126872 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:46.138625 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:46.150426 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:46.163609 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:53:46.176509 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:53:46.311164 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:53:46.429954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:46.897380 run create_hlr_db(pid=10655): Launched 04:53:47.054592 bus /sierra_2: Setting Powered False 04:53:48.115440 run create_hlr_db(pid=10655): Terminated: ok {rc=0} 04:53:48.517231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Launched 04:53:48.823857 run osmo-hlr_10.42.42.2(pid=10658): Launched 04:53:48.940394 run osmo-stp_10.42.42.5: Starting osmo-stp 04:53:49.443490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Launched 04:53:49.751406 run osmo-stp_10.42.42.5(pid=10661): Launched 04:53:49.870049 run osmo-msc_10.42.42.6: Starting osmo-msc 04:53:50.396170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10663): Launched 04:53:50.703727 run osmo-msc_10.42.42.6(pid=10664): Launched 04:53:50.875319 run osmo-stp_10.42.42.5(pid=10661): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] 04:53:51.004501 run osmo-stp_10.42.42.5(pid=10661): stdout: | (launched: 2022-12-14_04:53:49.694443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:51.133710 run osmo-stp_10.42.42.5(pid=10661): stderr: | [0;m[38;5;43m20221214045349865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045349866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045349866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045349866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:51.260482 run osmo-stp_10.42.42.5(pid=10661): stdout: | (launched: 2022-12-14_04:53:49.694443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:53:51.381080 run osmo-stp_10.42.42.5(pid=10661): stderr: | [0;m[38;5;43m20221214045349865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045349866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045349866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045349866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045349867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:53:51.525845 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10661): Process ended prematurely: osmo-stp_10.42.42.5(pid=10661) [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 04:53:51.534099 tst handover.py:18: Test FAILED (6.5 sec) 04:53:51.560124 run osmo-hlr_10.42.42.2(pid=10658): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10658)] 04:53:51.609055 run osmo-hlr_10.42.42.2(pid=10658): stdout: | (launched: 2022-12-14_04:53:48.766234) 04:53:51.658637 run osmo-hlr_10.42.42.2(pid=10658): stderr: | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045348943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045348956 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045348965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045348965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045348965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:53:51.727786 run osmo-msc_10.42.42.6(pid=10664): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10664)] 04:53:51.775028 run osmo-msc_10.42.42.6(pid=10664): stdout: | (launched: 2022-12-14_04:53:50.646090) 04:53:51.824705 run osmo-msc_10.42.42.6(pid=10664): stderr: | [0;m[38;5;43m20221214045350914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045350915 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61215d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045350915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045350915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045350915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045350915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045350917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045350917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045350917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045350917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:53:51.874333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Terminating (SIGTERM) 04:53:51.914195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Terminating (SIGTERM) 04:53:51.954116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10663): Terminating (SIGTERM) 04:53:51.994038 --- ParallelTerminationStrategy: PID 10657 died... 04:53:52.013261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10657): Terminated: ok {rc=0} 04:53:52.057310 --- ParallelTerminationStrategy: PID 10660 died... 04:53:52.076090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10660): Terminated: ok {rc=0} 04:53:52.119900 --- ParallelTerminationStrategy: PID 10663 died... 04:53:52.138660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10663): Terminated: ok {rc=0} 04:53:52.221953 bus /sierra_3: Setting Powered False 04:53:53.320192 bus /sierra_3: Setting Powered False 04:53:54.437148 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 04:53:55.697856 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:53:55.704568 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 04:53:55.742641 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 04:53:55.769961 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 04:53:55.824060 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 04:53:55.862661 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 04:53:55.890182 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 04:53:56.441309 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 04:53:56.446881 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:56.458329 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:53:56.493382 tst handover.py: using LAC 38679 04:53:56.623092 tst handover.py: using RAC 174 04:53:56.751302 tst handover.py: using CellId 38679 04:53:56.879405 tst handover.py: using BVCI 38680 04:53:56.997831 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 04:53:57.031573 tst handover.py: using LAC 38680 04:53:57.158510 tst handover.py: using RAC 175 04:53:57.284778 tst handover.py: using CellId 38680 04:53:57.413846 tst handover.py: using BVCI 38681 04:53:57.533153 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:57.544356 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:57.555437 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:57.566471 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:57.577769 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 04:53:57.589094 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:53:57.707314 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 04:53:57.830988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:53:58.312879 run create_hlr_db(pid=10669): Launched 04:53:58.446538 bus /sierra_2: Setting Powered False 04:53:59.507352 run create_hlr_db(pid=10669): Terminated: ok {rc=0} 04:53:59.928287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10671): Launched 04:54:00.257954 run osmo-hlr_10.42.42.2(pid=10672): Launched 04:54:00.384777 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:00.937617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10674): Launched 04:54:01.261677 run osmo-stp_10.42.42.5(pid=10675): Launched 04:54:01.518013 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:02.209465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10713): Launched 04:54:02.570424 run osmo-msc_10.42.42.6(pid=10726): Launched 04:54:02.955000 run osmo-stp_10.42.42.5(pid=10675): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10675)] 04:54:03.337192 run osmo-stp_10.42.42.5(pid=10675): stdout: | (launched: 2022-12-14_04:54:01.199477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:03.675086 run osmo-stp_10.42.42.5(pid=10675): stderr: | [0;m[38;5;43m20221214045401561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045401562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045401562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045401562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:03.878971 run osmo-stp_10.42.42.5(pid=10675): stdout: | (launched: 2022-12-14_04:54:01.199477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:04.031904 run osmo-stp_10.42.42.5(pid=10675): stderr: | [0;m[38;5;43m20221214045401561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045401562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045401562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045401562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045401563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:04.222053 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10675): Process ended prematurely: osmo-stp_10.42.42.5(pid=10675) [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10675)] [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 04:54:04.231531 tst handover.py:18: Test FAILED (7.8 sec) 04:54:04.263958 run osmo-hlr_10.42.42.2(pid=10672): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10672)] 04:54:04.322215 run osmo-hlr_10.42.42.2(pid=10672): stdout: | (launched: 2022-12-14_04:54:00.197167) 04:54:04.383095 run osmo-hlr_10.42.42.2(pid=10672): stderr: | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045400397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045400413 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045400422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045400422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045400422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:04.473433 run osmo-msc_10.42.42.6(pid=10726): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10726)] 04:54:04.527718 run osmo-msc_10.42.42.6(pid=10726): stdout: | (launched: 2022-12-14_04:54:02.511743) 04:54:04.578875 run osmo-msc_10.42.42.6(pid=10726): stderr: | [0;m[38;5;43m20221214045403205 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045403205 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5eb2483c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045403205 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045403205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045403205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045403206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045403207 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045403208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045403208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045403208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:04.639420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10671): Terminating (SIGTERM) 04:54:04.687234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10674): Terminating (SIGTERM) 04:54:04.743674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10713): Terminating (SIGTERM) 04:54:04.793357 --- ParallelTerminationStrategy: PID 10671 died... 04:54:04.814707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10671): Terminated: ok {rc=0} 04:54:04.863076 --- ParallelTerminationStrategy: PID 10674 died... 04:54:04.883878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10674): Terminated: ok {rc=0} 04:54:04.932029 --- ParallelTerminationStrategy: PID 10713 died... 04:54:04.952898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10713): Terminated: ok {rc=0} 04:54:05.044373 bus /sierra_3: Setting Powered False 04:54:06.143680 bus /sierra_3: Setting Powered False 04:54:07.259927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 04:54:08.503443 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:08.510424 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:54:08.565707 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:54:08.593444 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:54:08.643693 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:54:08.696392 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:54:08.725154 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:54:09.271541 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 04:54:09.278418 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:09.290189 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:09.328490 tst handover.py: using LAC 38681 04:54:09.451663 tst handover.py: using RAC 176 04:54:09.575001 tst handover.py: using CellId 38681 04:54:09.700357 tst handover.py: using BVCI 38682 04:54:09.819852 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:54:09.867078 tst handover.py: using LAC 38682 04:54:09.989768 tst handover.py: using RAC 177 04:54:10.112778 tst handover.py: using CellId 38682 04:54:10.234470 tst handover.py: using BVCI 38683 04:54:10.351056 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:10.362946 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:10.374662 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:10.386342 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:10.399533 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:54:10.412504 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:10.540013 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:54:10.662227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:11.134986 run create_hlr_db(pid=10968): Launched 04:54:11.294843 bus /sierra_2: Setting Powered False 04:54:12.358781 run create_hlr_db(pid=10968): Terminated: ok {rc=0} 04:54:12.775825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10970): Launched 04:54:13.122014 run osmo-hlr_10.42.42.2(pid=10971): Launched 04:54:13.367975 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:14.015802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10973): Launched 04:54:14.361236 run osmo-stp_10.42.42.5(pid=10974): Launched 04:54:14.609535 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:15.261128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10976): Launched 04:54:15.606320 run osmo-msc_10.42.42.6(pid=10977): Launched 04:54:16.015147 run osmo-stp_10.42.42.5(pid=10974): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10974)] 04:54:16.303602 run osmo-stp_10.42.42.5(pid=10974): stdout: | (launched: 2022-12-14_04:54:14.299664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:16.465529 run osmo-stp_10.42.42.5(pid=10974): stderr: | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045414596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:16.604416 run osmo-stp_10.42.42.5(pid=10974): stdout: | (launched: 2022-12-14_04:54:14.299664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:16.737271 run osmo-stp_10.42.42.5(pid=10974): stderr: | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045414595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045414596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045414596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:16.896337 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10974): Process ended prematurely: osmo-stp_10.42.42.5(pid=10974) [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10974)] [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 04:54:16.905947 tst handover.py:18: Test FAILED (7.6 sec) 04:54:16.934208 run osmo-hlr_10.42.42.2(pid=10971): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10971)] 04:54:16.985397 run osmo-hlr_10.42.42.2(pid=10971): stdout: | (launched: 2022-12-14_04:54:13.058603) 04:54:17.038684 run osmo-hlr_10.42.42.2(pid=10971): stderr: | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045413371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045413382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045413395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045413395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045413395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:17.112387 run osmo-msc_10.42.42.6(pid=10977): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10977)] 04:54:17.163562 run osmo-msc_10.42.42.6(pid=10977): stdout: | (launched: 2022-12-14_04:54:15.545090) 04:54:17.216455 run osmo-msc_10.42.42.6(pid=10977): stderr: | [0;m[38;5;43m20221214045416072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045416072 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f970c0edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045416072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045416072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045416072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045416072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045416082 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045416083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045416083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045416083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:17.269751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10970): Terminating (SIGTERM) 04:54:17.312740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10973): Terminating (SIGTERM) 04:54:17.357738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10976): Terminating (SIGTERM) 04:54:17.402932 --- ParallelTerminationStrategy: PID 10970 died... 04:54:17.423554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10970): Terminated: ok {rc=0} 04:54:17.472290 --- ParallelTerminationStrategy: PID 10973 died... 04:54:17.492420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10973): Terminated: ok {rc=0} 04:54:17.539323 --- ParallelTerminationStrategy: PID 10976 died... 04:54:17.559460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10976): Terminated: ok {rc=0} 04:54:17.656656 bus /sierra_3: Setting Powered False 04:54:18.806851 bus /sierra_3: Setting Powered False 04:54:19.929348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:54:21.217025 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:21.224043 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:54:21.274760 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:54:21.303279 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:54:21.357264 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:54:21.407394 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:54:21.436143 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:54:21.990163 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:54:21.997649 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:22.010549 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:22.048917 tst handover.py: using LAC 38683 04:54:22.182220 tst handover.py: using RAC 178 04:54:22.312885 tst handover.py: using CellId 38683 04:54:22.446408 tst handover.py: using BVCI 38684 04:54:22.573171 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:54:22.620938 tst handover.py: using LAC 38684 04:54:22.750861 tst handover.py: using RAC 179 04:54:22.880634 tst handover.py: using CellId 38684 04:54:23.015734 tst handover.py: using BVCI 38685 04:54:23.139880 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:23.152401 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:23.164715 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:23.177677 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:23.190318 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:54:23.202859 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:23.329944 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:54:23.456686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:23.957488 run create_hlr_db(pid=10983): Launched 04:54:24.130548 bus /sierra_2: Setting Powered False 04:54:25.197104 run create_hlr_db(pid=10983): Terminated: ok {rc=0} 04:54:25.622239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Launched 04:54:25.931974 run osmo-hlr_10.42.42.2(pid=10986): Launched 04:54:26.048594 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:26.552841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Launched 04:54:26.861559 run osmo-stp_10.42.42.5(pid=10989): Launched 04:54:26.979056 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:27.510614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10991): Launched 04:54:27.819465 run osmo-msc_10.42.42.6(pid=10992): Launched 04:54:27.994126 run osmo-stp_10.42.42.5(pid=10989): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] 04:54:28.124778 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-14_04:54:26.804130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:28.255062 run osmo-stp_10.42.42.5(pid=10989): stderr: | [0;m[38;5;43m20221214045426978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045426978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045426979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045426979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:28.383064 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-14_04:54:26.804130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:28.505244 run osmo-stp_10.42.42.5(pid=10989): stderr: | [0;m[38;5;43m20221214045426978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045426978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045426979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045426979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045426980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:28.651220 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 04:54:28.659753 tst handover.py:18: Test FAILED (6.7 sec) 04:54:28.686059 run osmo-hlr_10.42.42.2(pid=10986): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10986)] 04:54:28.735197 run osmo-hlr_10.42.42.2(pid=10986): stdout: | (launched: 2022-12-14_04:54:25.874256) 04:54:28.784939 run osmo-hlr_10.42.42.2(pid=10986): stderr: | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045426053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045426078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045426088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045426089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045426089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:28.854524 run osmo-msc_10.42.42.6(pid=10992): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10992)] 04:54:28.902144 run osmo-msc_10.42.42.6(pid=10992): stdout: | (launched: 2022-12-14_04:54:27.762145) 04:54:28.951564 run osmo-msc_10.42.42.6(pid=10992): stderr: | [0;m[38;5;43m20221214045428037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045428037 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efda5929c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045428037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045428037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045428037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045428038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045428039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045428040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045428040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045428040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:29.001281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminating (SIGTERM) 04:54:29.040766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminating (SIGTERM) 04:54:29.080157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10991): Terminating (SIGTERM) 04:54:29.119868 --- ParallelTerminationStrategy: PID 10985 died... 04:54:29.138612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminated: ok {rc=0} 04:54:29.182304 --- ParallelTerminationStrategy: PID 10988 died... 04:54:29.200904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminated: ok {rc=0} 04:54:29.244752 --- ParallelTerminationStrategy: PID 10991 died... 04:54:29.263526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10991): Terminated: ok {rc=0} 04:54:29.348823 bus /sierra_3: Setting Powered False 04:54:30.447470 bus /sierra_3: Setting Powered False 04:54:31.559087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:54:32.811432 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:32.816712 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:54:32.868645 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:54:32.895024 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:54:32.947887 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:54:32.998887 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:54:33.025021 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:54:33.574937 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:54:33.580516 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:33.591590 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:33.625758 tst handover.py: using LAC 38685 04:54:33.747693 tst handover.py: using RAC 180 04:54:33.870997 tst handover.py: using CellId 38685 04:54:33.993925 tst handover.py: using BVCI 38686 04:54:34.107776 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:54:34.156713 tst handover.py: using LAC 38686 04:54:34.277311 tst handover.py: using RAC 181 04:54:34.399329 tst handover.py: using CellId 38686 04:54:34.521371 tst handover.py: using BVCI 38687 04:54:34.632742 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:34.643902 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:34.654921 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:34.665872 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:34.677535 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:54:34.688899 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:34.811222 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:54:34.928880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:35.378272 run create_hlr_db(pid=10998): Launched 04:54:35.496910 bus /sierra_2: Setting Powered False 04:54:36.557878 run create_hlr_db(pid=10998): Terminated: ok {rc=0} 04:54:36.960922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11000): Launched 04:54:37.268473 run osmo-hlr_10.42.42.2(pid=11001): Launched 04:54:37.385701 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:37.905525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11003): Launched 04:54:38.212463 run osmo-stp_10.42.42.5(pid=11004): Launched 04:54:38.329936 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:38.860074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11006): Launched 04:54:39.168824 run osmo-msc_10.42.42.6(pid=11007): Launched 04:54:39.341712 run osmo-stp_10.42.42.5(pid=11004): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11004)] 04:54:39.471371 run osmo-stp_10.42.42.5(pid=11004): stdout: | (launched: 2022-12-14_04:54:38.155297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:39.600926 run osmo-stp_10.42.42.5(pid=11004): stderr: | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045438330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:39.728608 run osmo-stp_10.42.42.5(pid=11004): stdout: | (launched: 2022-12-14_04:54:38.155297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:39.850133 run osmo-stp_10.42.42.5(pid=11004): stderr: | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045438330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045438330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045438331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:39.996062 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11004): Process ended prematurely: osmo-stp_10.42.42.5(pid=11004) [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11004)] [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 04:54:40.004404 tst handover.py:18: Test FAILED (6.4 sec) 04:54:40.030904 run osmo-hlr_10.42.42.2(pid=11001): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11001)] 04:54:40.079672 run osmo-hlr_10.42.42.2(pid=11001): stdout: | (launched: 2022-12-14_04:54:37.211447) 04:54:40.129514 run osmo-hlr_10.42.42.2(pid=11001): stderr: | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045437391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045437403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045437412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045437412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045437412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:40.198922 run osmo-msc_10.42.42.6(pid=11007): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11007)] 04:54:40.246475 run osmo-msc_10.42.42.6(pid=11007): stdout: | (launched: 2022-12-14_04:54:39.111357) 04:54:40.295942 run osmo-msc_10.42.42.6(pid=11007): stderr: | [0;m[38;5;43m20221214045439384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045439385 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d5ede4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045439385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045439387 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045439387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045439387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045439387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:40.346038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11000): Terminating (SIGTERM) 04:54:40.385739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11003): Terminating (SIGTERM) 04:54:40.425441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11006): Terminating (SIGTERM) 04:54:40.465422 --- ParallelTerminationStrategy: PID 11000 died... 04:54:40.485007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11000): Terminated: ok {rc=0} 04:54:40.529114 --- ParallelTerminationStrategy: PID 11003 died... 04:54:40.548000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11003): Terminated: ok {rc=0} 04:54:40.591945 --- ParallelTerminationStrategy: PID 11006 died... 04:54:40.610915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11006): Terminated: ok {rc=0} 04:54:40.696760 bus /sierra_3: Setting Powered False 04:54:41.795701 bus /sierra_3: Setting Powered False 04:54:42.907794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 04:54:44.170608 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:44.176082 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:54:44.215414 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:54:44.242969 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:54:44.295403 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:54:44.334323 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:54:44.361548 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:54:44.913545 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 04:54:44.918923 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:44.930149 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:44.964369 tst handover.py: using LAC 38687 04:54:45.092794 tst handover.py: using RAC 182 04:54:45.221032 tst handover.py: using CellId 38687 04:54:45.349383 tst handover.py: using BVCI 38688 04:54:45.468559 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 04:54:45.508188 tst handover.py: using LAC 38688 04:54:45.637372 tst handover.py: using RAC 183 04:54:45.763891 tst handover.py: using CellId 38688 04:54:45.918149 tst handover.py: using BVCI 38689 04:54:46.048039 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:46.060194 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:46.071970 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:46.083808 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:46.095788 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:54:46.107980 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:46.253080 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 04:54:46.393993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:46.935464 run create_hlr_db(pid=11012): Launched 04:54:47.085387 bus /sierra_2: Setting Powered False 04:54:48.150523 run create_hlr_db(pid=11012): Terminated: ok {rc=0} 04:54:48.562381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11014): Launched 04:54:48.870702 run osmo-hlr_10.42.42.2(pid=11015): Launched 04:54:48.987814 run osmo-stp_10.42.42.5: Starting osmo-stp 04:54:49.504933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11018): Launched 04:54:49.813650 run osmo-stp_10.42.42.5(pid=11019): Launched 04:54:49.931336 run osmo-msc_10.42.42.6: Starting osmo-msc 04:54:50.460182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11021): Launched 04:54:50.768440 run osmo-msc_10.42.42.6(pid=11022): Launched 04:54:50.941227 run osmo-stp_10.42.42.5(pid=11019): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11019)] 04:54:51.071056 run osmo-stp_10.42.42.5(pid=11019): stdout: | (launched: 2022-12-14_04:54:49.756316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:51.201228 run osmo-stp_10.42.42.5(pid=11019): stderr: | [0;m[38;5;43m20221214045449930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045449931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045449931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045449931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:51.329280 run osmo-stp_10.42.42.5(pid=11019): stdout: | (launched: 2022-12-14_04:54:49.756316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:54:51.450725 run osmo-stp_10.42.42.5(pid=11019): stderr: | [0;m[38;5;43m20221214045449930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045449931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045449931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045449931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045449932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:54:51.596414 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11019): Process ended prematurely: osmo-stp_10.42.42.5(pid=11019) [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11019)] [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 04:54:51.604690 tst handover.py:18: Test FAILED (6.7 sec) 04:54:51.630976 run osmo-hlr_10.42.42.2(pid=11015): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11015)] 04:54:51.679444 run osmo-hlr_10.42.42.2(pid=11015): stdout: | (launched: 2022-12-14_04:54:48.812655) 04:54:51.729342 run osmo-hlr_10.42.42.2(pid=11015): stderr: | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045448990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045449010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045449018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045449018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045449018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:54:51.799053 run osmo-msc_10.42.42.6(pid=11022): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11022)] 04:54:51.846326 run osmo-msc_10.42.42.6(pid=11022): stdout: | (launched: 2022-12-14_04:54:50.711003) 04:54:51.896143 run osmo-msc_10.42.42.6(pid=11022): stderr: | [0;m[38;5;43m20221214045450985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045450985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1a3299c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045450985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045450985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045450986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045450986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045450989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045450990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045450990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045450990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:54:51.945985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11014): Terminating (SIGTERM) 04:54:51.985937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11018): Terminating (SIGTERM) 04:54:52.025830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11021): Terminating (SIGTERM) 04:54:52.065965 --- ParallelTerminationStrategy: PID 11014 died... 04:54:52.085550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11014): Terminated: ok {rc=0} 04:54:52.129790 --- ParallelTerminationStrategy: PID 11018 died... 04:54:52.148445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11018): Terminated: ok {rc=0} 04:54:52.192365 --- ParallelTerminationStrategy: PID 11021 died... 04:54:52.211284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11021): Terminated: ok {rc=0} 04:54:52.295429 bus /sierra_3: Setting Powered False 04:54:53.390954 bus /sierra_3: Setting Powered False 04:54:54.507118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 04:54:55.746687 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:54:55.751704 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:54:55.802194 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:54:55.828404 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:54:55.881106 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:54:55.934918 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:54:55.962912 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:54:56.514887 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 04:54:56.521428 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:56.532645 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:54:56.567459 tst handover.py: using LAC 38689 04:54:56.696895 tst handover.py: using RAC 184 04:54:56.824700 tst handover.py: using CellId 38689 04:54:56.953020 tst handover.py: using BVCI 38690 04:54:57.073286 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:54:57.122263 tst handover.py: using LAC 38690 04:54:57.251136 tst handover.py: using RAC 185 04:54:57.381941 tst handover.py: using CellId 38690 04:54:57.514281 tst handover.py: using BVCI 38691 04:54:57.636107 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:57.647388 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:57.658510 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:57.669724 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:57.681395 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:54:57.692878 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:54:57.809274 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:54:57.925868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:54:58.377093 run create_hlr_db(pid=11027): Launched 04:54:58.494394 bus /sierra_2: Setting Powered False 04:54:59.554695 run create_hlr_db(pid=11027): Terminated: ok {rc=0} 04:54:59.975111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11029): Launched 04:55:00.305525 run osmo-hlr_10.42.42.2(pid=11030): Launched 04:55:00.431152 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:00.995269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11032): Launched 04:55:01.315356 run osmo-stp_10.42.42.5(pid=11033): Launched 04:55:01.619359 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:02.209782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11038): Launched 04:55:02.548652 run osmo-msc_10.42.42.6(pid=11039): Launched 04:55:02.734247 run osmo-stp_10.42.42.5(pid=11033): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11033)] 04:55:02.871488 run osmo-stp_10.42.42.5(pid=11033): stdout: | (launched: 2022-12-14_04:55:01.257159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:03.009804 run osmo-stp_10.42.42.5(pid=11033): stderr: | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045501488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:03.146421 run osmo-stp_10.42.42.5(pid=11033): stdout: | (launched: 2022-12-14_04:55:01.257159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:03.276234 run osmo-stp_10.42.42.5(pid=11033): stderr: | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045501488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045501488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045501490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:03.431597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11033): Process ended prematurely: osmo-stp_10.42.42.5(pid=11033) [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11033)] [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 04:55:03.440682 tst handover.py:18: Test FAILED (6.9 sec) 04:55:03.468204 run osmo-hlr_10.42.42.2(pid=11030): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11030)] 04:55:03.518818 run osmo-hlr_10.42.42.2(pid=11030): stdout: | (launched: 2022-12-14_04:55:00.244365) 04:55:03.570829 run osmo-hlr_10.42.42.2(pid=11030): stderr: | [0;m[1;31m20221214045500445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045500445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045500446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045500446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045500446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045500446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045500458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045500466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045500467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045500467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:03.643182 run osmo-msc_10.42.42.6(pid=11039): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11039)] 04:55:03.693202 run osmo-msc_10.42.42.6(pid=11039): stdout: | (launched: 2022-12-14_04:55:02.487048) 04:55:03.744719 run osmo-msc_10.42.42.6(pid=11039): stderr: | [0;m[38;5;43m20221214045502810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045502810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1bbe0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045502810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045502810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045502810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045502811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045502812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045502813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045502813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045502813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:03.796591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11029): Terminating (SIGTERM) 04:55:03.837925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11032): Terminating (SIGTERM) 04:55:03.879222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11038): Terminating (SIGTERM) 04:55:03.920879 --- ParallelTerminationStrategy: PID 11029 died... 04:55:03.940849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11029): Terminated: ok {rc=0} 04:55:03.987015 --- ParallelTerminationStrategy: PID 11032 died... 04:55:04.006600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11032): Terminated: ok {rc=0} 04:55:04.052280 --- ParallelTerminationStrategy: PID 11038 died... 04:55:04.071765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11038): Terminated: ok {rc=0} 04:55:04.159148 bus /sierra_3: Setting Powered False 04:55:05.257949 bus /sierra_3: Setting Powered False 04:55:06.372721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 04:55:07.630589 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:07.636673 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:55:07.688183 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:55:07.715542 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:55:07.770661 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:55:07.820423 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:55:07.846803 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:55:08.399213 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 04:55:08.404529 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:08.415856 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:08.450688 tst handover.py: using LAC 38691 04:55:08.572069 tst handover.py: using RAC 186 04:55:08.694006 tst handover.py: using CellId 38691 04:55:08.817383 tst handover.py: using BVCI 38692 04:55:08.937145 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:55:08.987169 tst handover.py: using LAC 38692 04:55:09.115803 tst handover.py: using RAC 187 04:55:09.244294 tst handover.py: using CellId 38692 04:55:09.366275 tst handover.py: using BVCI 38693 04:55:09.487201 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:09.498766 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:09.510173 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:09.521447 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:09.533560 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:55:09.544915 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:09.662754 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:55:09.782218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:10.263577 run create_hlr_db(pid=11044): Launched 04:55:10.395736 bus /sierra_2: Setting Powered False 04:55:11.460031 run create_hlr_db(pid=11044): Terminated: ok {rc=0} 04:55:11.889023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Launched 04:55:12.217386 run osmo-hlr_10.42.42.2(pid=11047): Launched 04:55:12.343664 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:12.884037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Launched 04:55:13.211901 run osmo-stp_10.42.42.5(pid=11050): Launched 04:55:13.336839 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:13.903097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11052): Launched 04:55:14.233788 run osmo-msc_10.42.42.6(pid=11053): Launched 04:55:14.417239 run osmo-stp_10.42.42.5(pid=11050): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] 04:55:14.556039 run osmo-stp_10.42.42.5(pid=11050): stdout: | (launched: 2022-12-14_04:55:13.151137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:14.695010 run osmo-stp_10.42.42.5(pid=11050): stderr: | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045513347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:14.832757 run osmo-stp_10.42.42.5(pid=11050): stdout: | (launched: 2022-12-14_04:55:13.151137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:14.963201 run osmo-stp_10.42.42.5(pid=11050): stderr: | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045513346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045513347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045513347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:15.119179 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11050): Process ended prematurely: osmo-stp_10.42.42.5(pid=11050) [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 04:55:15.128106 tst handover.py:18: Test FAILED (6.7 sec) 04:55:15.155632 run osmo-hlr_10.42.42.2(pid=11047): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11047)] 04:55:15.205812 run osmo-hlr_10.42.42.2(pid=11047): stdout: | (launched: 2022-12-14_04:55:12.156439) 04:55:15.257625 run osmo-hlr_10.42.42.2(pid=11047): stderr: | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045512358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045512371 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045512379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045512380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045512380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:15.330142 run osmo-msc_10.42.42.6(pid=11053): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11053)] 04:55:15.380197 run osmo-msc_10.42.42.6(pid=11053): stdout: | (launched: 2022-12-14_04:55:14.172563) 04:55:15.431741 run osmo-msc_10.42.42.6(pid=11053): stderr: | [0;m[38;5;43m20221214045514498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045514498 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f446c6ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045514498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045514498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045514498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045514498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045514500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045514500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045514501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045514501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:15.484148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Terminating (SIGTERM) 04:55:15.525769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Terminating (SIGTERM) 04:55:15.567551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11052): Terminating (SIGTERM) 04:55:15.609383 --- ParallelTerminationStrategy: PID 11046 died... 04:55:15.629288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11046): Terminated: ok {rc=0} 04:55:15.675407 --- ParallelTerminationStrategy: PID 11049 died... 04:55:15.694762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11049): Terminated: ok {rc=0} 04:55:15.740470 --- ParallelTerminationStrategy: PID 11052 died... 04:55:15.760045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11052): Terminated: ok {rc=0} 04:55:15.854092 bus /sierra_3: Setting Powered False 04:55:16.953885 bus /sierra_3: Setting Powered False 04:55:18.068308 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 04:55:19.325417 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:19.331018 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 04:55:19.381179 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 04:55:19.408532 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 04:55:19.461732 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 04:55:19.511307 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 04:55:19.538045 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 04:55:20.088665 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 04:55:20.094700 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:20.105966 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:55:20.139682 tst handover.py: using LAC 38693 04:55:20.262339 tst handover.py: using RAC 188 04:55:20.382679 tst handover.py: using CellId 38693 04:55:20.504898 tst handover.py: using BVCI 38694 04:55:20.625506 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 04:55:20.675234 tst handover.py: using LAC 38694 04:55:20.806574 tst handover.py: using RAC 189 04:55:20.927872 tst handover.py: using CellId 38694 04:55:21.055131 tst handover.py: using BVCI 38695 04:55:21.175530 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:21.187124 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:21.198465 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:21.209779 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:21.220911 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 04:55:21.232795 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:55:21.350851 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 04:55:21.470460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:21.951982 run create_hlr_db(pid=11058): Launched 04:55:22.084773 bus /sierra_2: Setting Powered False 04:55:23.149663 run create_hlr_db(pid=11058): Terminated: ok {rc=0} 04:55:23.579092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11060): Launched 04:55:23.908116 run osmo-hlr_10.42.42.2(pid=11061): Launched 04:55:24.032625 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:24.574139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11063): Launched 04:55:24.901928 run osmo-stp_10.42.42.5(pid=11064): Launched 04:55:25.027056 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:25.598268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11066): Launched 04:55:25.927641 run osmo-msc_10.42.42.6(pid=11067): Launched 04:55:26.112269 run osmo-stp_10.42.42.5(pid=11064): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11064)] 04:55:26.251431 run osmo-stp_10.42.42.5(pid=11064): stdout: | (launched: 2022-12-14_04:55:24.841220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:26.392301 run osmo-stp_10.42.42.5(pid=11064): stderr: | [0;m[38;5;43m20221214045525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045525036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045525036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045525036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045525038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045525039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045525039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:26.530086 run osmo-stp_10.42.42.5(pid=11064): stdout: | (launched: 2022-12-14_04:55:24.841220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:26.660710 run osmo-stp_10.42.42.5(pid=11064): stderr: | [0;m[38;5;43m20221214045525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045525036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045525036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045525036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045525038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045525039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045525039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:26.816890 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11064): Process ended prematurely: osmo-stp_10.42.42.5(pid=11064) [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11064)] [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 04:55:26.826052 tst handover.py:18: Test FAILED (6.7 sec) 04:55:26.853658 run osmo-hlr_10.42.42.2(pid=11061): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11061)] 04:55:26.903626 run osmo-hlr_10.42.42.2(pid=11061): stdout: | (launched: 2022-12-14_04:55:23.846885) 04:55:26.955109 run osmo-hlr_10.42.42.2(pid=11061): stderr: | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045524046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045524061 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045524069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045524070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045524070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:27.026873 run osmo-msc_10.42.42.6(pid=11067): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11067)] 04:55:27.076601 run osmo-msc_10.42.42.6(pid=11067): stdout: | (launched: 2022-12-14_04:55:25.866770) 04:55:27.128287 run osmo-msc_10.42.42.6(pid=11067): stderr: | [0;m[38;5;43m20221214045526189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045526189 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feeae9d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045526189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045526189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045526190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045526190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045526191 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045526192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045526192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045526192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:27.179904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11060): Terminating (SIGTERM) 04:55:27.221386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11063): Terminating (SIGTERM) 04:55:27.262824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11066): Terminating (SIGTERM) 04:55:27.304323 --- ParallelTerminationStrategy: PID 11060 died... 04:55:27.324193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11060): Terminated: ok {rc=0} 04:55:27.370290 --- ParallelTerminationStrategy: PID 11063 died... 04:55:27.389733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11063): Terminated: ok {rc=0} 04:55:27.435576 --- ParallelTerminationStrategy: PID 11066 died... 04:55:27.455157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11066): Terminated: ok {rc=0} 04:55:27.543621 bus /sierra_3: Setting Powered False 04:55:28.642002 bus /sierra_3: Setting Powered False 04:55:29.758922 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:55:31.051252 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:31.058466 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:55:31.106959 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:55:31.137207 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:55:31.190242 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:55:31.239175 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:55:31.268288 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:55:31.821566 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:55:31.827347 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:31.840222 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:31.875323 tst handover.py: using LAC 38695 04:55:32.021236 tst handover.py: using RAC 190 04:55:32.152781 tst handover.py: using CellId 38695 04:55:32.301264 tst handover.py: using BVCI 38696 04:55:32.421817 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:55:32.466994 tst handover.py: using LAC 38696 04:55:32.596604 tst handover.py: using RAC 191 04:55:32.723197 tst handover.py: using CellId 38696 04:55:32.843050 tst handover.py: using BVCI 38697 04:55:32.954901 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:32.966084 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:32.977063 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:32.987989 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:32.999388 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:55:33.010572 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:33.128031 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:55:33.248911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:33.731425 run create_hlr_db(pid=11072): Launched 04:55:33.866446 bus /sierra_2: Setting Powered False 04:55:34.931502 run create_hlr_db(pid=11072): Terminated: ok {rc=0} 04:55:35.344734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Launched 04:55:35.654244 run osmo-hlr_10.42.42.2(pid=11075): Launched 04:55:35.772388 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:36.280195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Launched 04:55:36.589311 run osmo-stp_10.42.42.5(pid=11078): Launched 04:55:36.707315 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:37.237644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11080): Launched 04:55:37.547121 run osmo-msc_10.42.42.6(pid=11081): Launched 04:55:37.721117 run osmo-stp_10.42.42.5(pid=11078): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] 04:55:37.851395 run osmo-stp_10.42.42.5(pid=11078): stdout: | (launched: 2022-12-14_04:55:36.532107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:37.981940 run osmo-stp_10.42.42.5(pid=11078): stderr: | [0;m[38;5;43m20221214045536703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045536703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045536704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045536704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045536704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045536705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045536705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:38.109933 run osmo-stp_10.42.42.5(pid=11078): stdout: | (launched: 2022-12-14_04:55:36.532107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:38.231693 run osmo-stp_10.42.42.5(pid=11078): stderr: | [0;m[38;5;43m20221214045536703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045536703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045536704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045536704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045536704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045536705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045536705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:38.376917 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11078): Process ended prematurely: osmo-stp_10.42.42.5(pid=11078) [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 04:55:38.385337 tst handover.py:18: Test FAILED (6.6 sec) 04:55:38.411639 run osmo-hlr_10.42.42.2(pid=11075): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11075)] 04:55:38.461086 run osmo-hlr_10.42.42.2(pid=11075): stdout: | (launched: 2022-12-14_04:55:35.597118) 04:55:38.510876 run osmo-hlr_10.42.42.2(pid=11075): stderr: | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045535777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045535788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045535796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045535797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045535797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:38.580337 run osmo-msc_10.42.42.6(pid=11081): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11081)] 04:55:38.627861 run osmo-msc_10.42.42.6(pid=11081): stdout: | (launched: 2022-12-14_04:55:37.489488) 04:55:38.677623 run osmo-msc_10.42.42.6(pid=11081): stderr: | [0;m[38;5;43m20221214045537762 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045537763 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f70ea3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045537763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045537763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045537763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045537763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045537765 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045537765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045537765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045537766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:38.727524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Terminating (SIGTERM) 04:55:38.767326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Terminating (SIGTERM) 04:55:38.807198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11080): Terminating (SIGTERM) 04:55:38.847279 --- ParallelTerminationStrategy: PID 11074 died... 04:55:38.866730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Terminated: ok {rc=0} 04:55:38.910676 --- ParallelTerminationStrategy: PID 11077 died... 04:55:38.929644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Terminated: ok {rc=0} 04:55:38.973277 --- ParallelTerminationStrategy: PID 11080 died... 04:55:38.992069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11080): Terminated: ok {rc=0} 04:55:39.075672 bus /sierra_3: Setting Powered False 04:55:40.173455 bus /sierra_3: Setting Powered False 04:55:41.291072 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:55:42.550747 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:42.557151 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:55:42.606598 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:55:42.634073 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:55:42.690929 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:55:42.743355 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:55:42.769676 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:55:43.312226 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:55:43.319374 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:43.331583 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:43.366670 tst handover.py: using LAC 38697 04:55:43.486734 tst handover.py: using RAC 192 04:55:43.606592 tst handover.py: using CellId 38697 04:55:43.725845 tst handover.py: using BVCI 38698 04:55:43.845782 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:55:43.894629 tst handover.py: using LAC 38698 04:55:44.021409 tst handover.py: using RAC 193 04:55:44.150679 tst handover.py: using CellId 38698 04:55:44.282083 tst handover.py: using BVCI 38699 04:55:44.402480 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:44.414047 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:44.425336 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:44.436520 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:44.448049 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:55:44.459337 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:44.577756 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:55:44.698834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:45.180247 run create_hlr_db(pid=11086): Launched 04:55:45.314063 bus /sierra_2: Setting Powered False 04:55:46.377941 run create_hlr_db(pid=11086): Terminated: ok {rc=0} 04:55:46.813239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Launched 04:55:47.153783 run osmo-hlr_10.42.42.2(pid=11089): Launched 04:55:47.307282 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:47.848829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Launched 04:55:48.179123 run osmo-stp_10.42.42.5(pid=11092): Launched 04:55:48.307329 run osmo-msc_10.42.42.6: Starting osmo-msc 04:55:48.875334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Launched 04:55:49.204698 run osmo-msc_10.42.42.6(pid=11095): Launched 04:55:49.388399 run osmo-stp_10.42.42.5(pid=11092): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] 04:55:49.527162 run osmo-stp_10.42.42.5(pid=11092): stdout: | (launched: 2022-12-14_04:55:48.118228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:49.666137 run osmo-stp_10.42.42.5(pid=11092): stderr: | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045548313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:49.803582 run osmo-stp_10.42.42.5(pid=11092): stdout: | (launched: 2022-12-14_04:55:48.118228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:55:49.934115 run osmo-stp_10.42.42.5(pid=11092): stderr: | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045548313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045548313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045548314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:55:50.090606 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11092): Process ended prematurely: osmo-stp_10.42.42.5(pid=11092) [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 04:55:50.099694 tst handover.py:18: Test FAILED (6.8 sec) 04:55:50.127508 run osmo-hlr_10.42.42.2(pid=11089): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11089)] 04:55:50.178011 run osmo-hlr_10.42.42.2(pid=11089): stdout: | (launched: 2022-12-14_04:55:47.093779) 04:55:50.230296 run osmo-hlr_10.42.42.2(pid=11089): stderr: | [0;m[1;31m20221214045547317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045547317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045547317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045547317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045547317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045547318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045547330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045547339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045547339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045547339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:55:50.302697 run osmo-msc_10.42.42.6(pid=11095): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11095)] 04:55:50.353475 run osmo-msc_10.42.42.6(pid=11095): stdout: | (launched: 2022-12-14_04:55:49.143750) 04:55:50.405497 run osmo-msc_10.42.42.6(pid=11095): stderr: | [0;m[38;5;43m20221214045549467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045549467 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99d5a66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045549467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045549467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045549468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045549468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045549471 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045549472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045549472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045549472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:55:50.457846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Terminating (SIGTERM) 04:55:50.500319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Terminating (SIGTERM) 04:55:50.543000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Terminating (SIGTERM) 04:55:50.585808 --- ParallelTerminationStrategy: PID 11088 died... 04:55:50.605756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Terminated: ok {rc=0} 04:55:50.652268 --- ParallelTerminationStrategy: PID 11091 died... 04:55:50.672127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Terminated: ok {rc=0} 04:55:50.718588 --- ParallelTerminationStrategy: PID 11094 died... 04:55:50.738464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Terminated: ok {rc=0} 04:55:50.825967 bus /sierra_3: Setting Powered False 04:55:51.924607 bus /sierra_3: Setting Powered False 04:55:53.047093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 04:55:54.307493 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:55:54.312550 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:55:54.348747 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:55:54.375710 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:55:54.427692 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:55:54.465578 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:55:54.493647 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:55:55.038713 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 04:55:55.044901 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:55.056541 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:55.090074 tst handover.py: using LAC 38699 04:55:55.220390 tst handover.py: using RAC 194 04:55:55.348588 tst handover.py: using CellId 38699 04:55:55.476815 tst handover.py: using BVCI 38700 04:55:55.596768 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 04:55:55.632592 tst handover.py: using LAC 38700 04:55:55.761945 tst handover.py: using RAC 195 04:55:55.890199 tst handover.py: using CellId 38700 04:55:56.019881 tst handover.py: using BVCI 38701 04:55:56.141161 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:56.152292 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:56.163282 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:56.174397 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:56.185470 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:55:56.196510 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:56.315941 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 04:55:56.432786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:55:56.882514 run create_hlr_db(pid=11102): Launched 04:55:57.001740 bus /sierra_2: Setting Powered False 04:55:58.063117 run create_hlr_db(pid=11102): Terminated: ok {rc=0} 04:55:58.465445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Launched 04:55:58.774260 run osmo-hlr_10.42.42.2(pid=11105): Launched 04:55:58.893112 run osmo-stp_10.42.42.5: Starting osmo-stp 04:55:59.410859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Launched 04:55:59.717183 run osmo-stp_10.42.42.5(pid=11108): Launched 04:55:59.834545 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:00.363014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Launched 04:56:00.672178 run osmo-msc_10.42.42.6(pid=11111): Launched 04:56:00.887295 run osmo-stp_10.42.42.5(pid=11108): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] 04:56:01.162462 run osmo-stp_10.42.42.5(pid=11108): stdout: | (launched: 2022-12-14_04:55:59.659913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:01.292525 run osmo-stp_10.42.42.5(pid=11108): stderr: | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045559834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:01.423086 run osmo-stp_10.42.42.5(pid=11108): stdout: | (launched: 2022-12-14_04:55:59.659913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:01.547211 run osmo-stp_10.42.42.5(pid=11108): stderr: | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045559833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045559834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045559834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:01.696724 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11108): Process ended prematurely: osmo-stp_10.42.42.5(pid=11108) [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 04:56:01.706197 tst handover.py:18: Test FAILED (6.7 sec) 04:56:01.733746 run osmo-hlr_10.42.42.2(pid=11105): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11105)] 04:56:01.786749 run osmo-hlr_10.42.42.2(pid=11105): stdout: | (launched: 2022-12-14_04:55:58.716645) 04:56:01.839420 run osmo-hlr_10.42.42.2(pid=11105): stderr: | [0;m[1;31m20221214045558895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045558895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045558895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045558895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045558895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045558896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045558919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045558929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045558930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045558930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:01.912428 run osmo-msc_10.42.42.6(pid=11111): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11111)] 04:56:01.961534 run osmo-msc_10.42.42.6(pid=11111): stdout: | (launched: 2022-12-14_04:56:00.614864) 04:56:02.013480 run osmo-msc_10.42.42.6(pid=11111): stderr: | [0;m[38;5;43m20221214045600892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045600893 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cf663fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045600893 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045600893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045600893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045600893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045600895 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045600895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045600895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045600895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:02.065763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Terminating (SIGTERM) 04:56:02.108277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Terminating (SIGTERM) 04:56:02.150529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Terminating (SIGTERM) 04:56:02.192491 --- ParallelTerminationStrategy: PID 11104 died... 04:56:02.213549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Terminated: ok {rc=0} 04:56:02.260111 --- ParallelTerminationStrategy: PID 11107 died... 04:56:02.281581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Terminated: ok {rc=0} 04:56:02.326967 --- ParallelTerminationStrategy: PID 11110 died... 04:56:02.346619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Terminated: ok {rc=0} 04:56:02.434726 bus /sierra_3: Setting Powered False 04:56:03.533704 bus /sierra_3: Setting Powered False 04:56:04.645892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 04:56:05.888306 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:05.893907 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:56:05.943688 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:56:05.970772 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:56:06.023210 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:56:06.073274 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:56:06.100179 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:56:06.651942 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 04:56:06.657613 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:06.669420 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:06.702725 tst handover.py: using LAC 38701 04:56:06.823712 tst handover.py: using RAC 196 04:56:06.946361 tst handover.py: using CellId 38701 04:56:07.068589 tst handover.py: using BVCI 38702 04:56:07.181631 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:56:07.229375 tst handover.py: using LAC 38702 04:56:07.350749 tst handover.py: using RAC 197 04:56:07.473160 tst handover.py: using CellId 38702 04:56:07.608551 tst handover.py: using BVCI 38703 04:56:07.729857 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:07.741688 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:07.752940 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:07.764516 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:07.776357 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:56:07.788157 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:07.907227 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:56:08.026209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:08.507280 run create_hlr_db(pid=11116): Launched 04:56:08.639838 bus /sierra_2: Setting Powered False 04:56:09.703938 run create_hlr_db(pid=11116): Terminated: ok {rc=0} 04:56:10.116800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11118): Launched 04:56:10.426210 run osmo-hlr_10.42.42.2(pid=11119): Launched 04:56:10.543649 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:11.047699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11121): Launched 04:56:11.355941 run osmo-stp_10.42.42.5(pid=11122): Launched 04:56:11.474812 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:12.002839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11124): Launched 04:56:12.311331 run osmo-msc_10.42.42.6(pid=11125): Launched 04:56:12.497698 run osmo-stp_10.42.42.5(pid=11122): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11122)] 04:56:12.638626 run osmo-stp_10.42.42.5(pid=11122): stdout: | (launched: 2022-12-14_04:56:11.298840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:12.781497 run osmo-stp_10.42.42.5(pid=11122): stderr: | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045611470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:12.919020 run osmo-stp_10.42.42.5(pid=11122): stdout: | (launched: 2022-12-14_04:56:11.298840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:13.049238 run osmo-stp_10.42.42.5(pid=11122): stderr: | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045611469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045611470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045611470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:13.205005 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11122): Process ended prematurely: osmo-stp_10.42.42.5(pid=11122) [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11122)] [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 04:56:13.214347 tst handover.py:18: Test FAILED (6.5 sec) 04:56:13.242301 run osmo-hlr_10.42.42.2(pid=11119): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11119)] 04:56:13.293132 run osmo-hlr_10.42.42.2(pid=11119): stdout: | (launched: 2022-12-14_04:56:10.368932) 04:56:13.345407 run osmo-hlr_10.42.42.2(pid=11119): stderr: | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045610546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045610559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045610569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045610569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045610569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:13.418133 run osmo-msc_10.42.42.6(pid=11125): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11125)] 04:56:13.468565 run osmo-msc_10.42.42.6(pid=11125): stdout: | (launched: 2022-12-14_04:56:12.253730) 04:56:13.520921 run osmo-msc_10.42.42.6(pid=11125): stderr: | [0;m[38;5;43m20221214045612576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045612576 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f9ed4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045612576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045612576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045612576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045612577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045612578 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045612579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045612579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045612579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:13.573379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11118): Terminating (SIGTERM) 04:56:13.615151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11121): Terminating (SIGTERM) 04:56:13.657054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11124): Terminating (SIGTERM) 04:56:13.699133 --- ParallelTerminationStrategy: PID 11118 died... 04:56:13.719519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11118): Terminated: ok {rc=0} 04:56:13.765901 --- ParallelTerminationStrategy: PID 11121 died... 04:56:13.785563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11121): Terminated: ok {rc=0} 04:56:13.832016 --- ParallelTerminationStrategy: PID 11124 died... 04:56:13.852096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11124): Terminated: ok {rc=0} 04:56:13.942478 bus /sierra_3: Setting Powered False 04:56:15.041427 bus /sierra_3: Setting Powered False 04:56:16.176634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 04:56:17.441667 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:17.447630 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:56:17.497214 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:56:17.524903 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:56:17.577288 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:56:17.627988 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:56:17.655487 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:56:18.206823 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 04:56:18.212221 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:18.223495 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:18.258414 tst handover.py: using LAC 38703 04:56:18.381918 tst handover.py: using RAC 198 04:56:18.505382 tst handover.py: using CellId 38703 04:56:18.625961 tst handover.py: using BVCI 38704 04:56:18.737702 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:56:18.784929 tst handover.py: using LAC 38704 04:56:18.909698 tst handover.py: using RAC 199 04:56:19.041705 tst handover.py: using CellId 38704 04:56:19.171588 tst handover.py: using BVCI 38705 04:56:19.291688 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:19.303248 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:19.314669 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:19.325984 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:19.337919 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:56:19.349898 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:19.466351 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:56:19.590620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:20.074241 run create_hlr_db(pid=11130): Launched 04:56:20.209338 bus /sierra_2: Setting Powered False 04:56:21.274272 run create_hlr_db(pid=11130): Terminated: ok {rc=0} 04:56:21.688149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11132): Launched 04:56:22.020155 run osmo-hlr_10.42.42.2(pid=11133): Launched 04:56:22.145910 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:22.684636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11135): Launched 04:56:23.014476 run osmo-stp_10.42.42.5(pid=11136): Launched 04:56:23.142066 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:23.712140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11138): Launched 04:56:24.044250 run osmo-msc_10.42.42.6(pid=11139): Launched 04:56:24.229246 run osmo-stp_10.42.42.5(pid=11136): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11136)] 04:56:24.368113 run osmo-stp_10.42.42.5(pid=11136): stdout: | (launched: 2022-12-14_04:56:22.953416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:24.507460 run osmo-stp_10.42.42.5(pid=11136): stderr: | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045623150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:24.646691 run osmo-stp_10.42.42.5(pid=11136): stdout: | (launched: 2022-12-14_04:56:22.953416) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:24.777732 run osmo-stp_10.42.42.5(pid=11136): stderr: | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045623149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045623150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045623150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:24.935562 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11136): Process ended prematurely: osmo-stp_10.42.42.5(pid=11136) [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11136)] [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 04:56:24.944618 tst handover.py:18: Test FAILED (6.7 sec) 04:56:24.972389 run osmo-hlr_10.42.42.2(pid=11133): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11133)] 04:56:25.022824 run osmo-hlr_10.42.42.2(pid=11133): stdout: | (launched: 2022-12-14_04:56:21.959202) 04:56:25.075096 run osmo-hlr_10.42.42.2(pid=11133): stderr: | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045622162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045622174 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045622182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045622182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045622182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:25.147937 run osmo-msc_10.42.42.6(pid=11139): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11139)] 04:56:25.198372 run osmo-msc_10.42.42.6(pid=11139): stdout: | (launched: 2022-12-14_04:56:23.983193) 04:56:25.249997 run osmo-msc_10.42.42.6(pid=11139): stderr: | [0;m[38;5;43m20221214045624310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045624310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0632b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045624310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045624310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045624310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045624311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045624312 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045624313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045624313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045624313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:25.301808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11132): Terminating (SIGTERM) 04:56:25.343643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11135): Terminating (SIGTERM) 04:56:25.385732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11138): Terminating (SIGTERM) 04:56:25.428145 --- ParallelTerminationStrategy: PID 11132 died... 04:56:25.448313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11132): Terminated: ok {rc=0} 04:56:25.495006 --- ParallelTerminationStrategy: PID 11135 died... 04:56:25.515152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11135): Terminated: ok {rc=0} 04:56:25.561804 --- ParallelTerminationStrategy: PID 11138 died... 04:56:25.581622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11138): Terminated: ok {rc=0} 04:56:25.670341 bus /sierra_3: Setting Powered False 04:56:26.770838 bus /sierra_3: Setting Powered False 04:56:27.887401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 04:56:29.146732 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:29.152805 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 04:56:29.212903 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 04:56:29.240543 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 04:56:29.292597 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 04:56:29.353526 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 04:56:29.380818 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 04:56:29.935477 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 04:56:29.940908 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:29.952410 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:56:30.001369 tst handover.py: using LAC 38705 04:56:30.131887 tst handover.py: using RAC 200 04:56:30.262334 tst handover.py: using CellId 38705 04:56:30.393073 tst handover.py: using BVCI 38706 04:56:30.511917 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 04:56:30.559303 tst handover.py: using LAC 38706 04:56:30.689520 tst handover.py: using RAC 201 04:56:30.819813 tst handover.py: using CellId 38706 04:56:30.978304 tst handover.py: using BVCI 38707 04:56:31.102448 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:31.114625 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:31.127011 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:31.139532 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:31.152549 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 04:56:31.165653 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:56:31.290884 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 04:56:31.413862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:31.943018 run create_hlr_db(pid=11144): Launched 04:56:32.103353 bus /sierra_2: Setting Powered False 04:56:33.164614 run create_hlr_db(pid=11144): Terminated: ok {rc=0} 04:56:33.568062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Launched 04:56:33.876785 run osmo-hlr_10.42.42.2(pid=11147): Launched 04:56:33.995356 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:34.517599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Launched 04:56:34.826758 run osmo-stp_10.42.42.5(pid=11150): Launched 04:56:34.947650 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:35.480373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11152): Launched 04:56:35.791012 run osmo-msc_10.42.42.6(pid=11153): Launched 04:56:35.964626 run osmo-stp_10.42.42.5(pid=11150): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] 04:56:36.094892 run osmo-stp_10.42.42.5(pid=11150): stdout: | (launched: 2022-12-14_04:56:34.768905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:36.224939 run osmo-stp_10.42.42.5(pid=11150): stderr: | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045634942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:36.353077 run osmo-stp_10.42.42.5(pid=11150): stdout: | (launched: 2022-12-14_04:56:34.768905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:36.474890 run osmo-stp_10.42.42.5(pid=11150): stderr: | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045634941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045634942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045634944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:36.620424 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11150): Process ended prematurely: osmo-stp_10.42.42.5(pid=11150) [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 04:56:36.628751 tst handover.py:18: Test FAILED (6.7 sec) 04:56:36.654719 run osmo-hlr_10.42.42.2(pid=11147): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11147)] 04:56:36.702947 run osmo-hlr_10.42.42.2(pid=11147): stdout: | (launched: 2022-12-14_04:56:33.819065) 04:56:36.752869 run osmo-hlr_10.42.42.2(pid=11147): stderr: | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045633995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045634007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045634015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045634016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045634016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:36.822270 run osmo-msc_10.42.42.6(pid=11153): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11153)] 04:56:36.869627 run osmo-msc_10.42.42.6(pid=11153): stdout: | (launched: 2022-12-14_04:56:35.733564) 04:56:36.919152 run osmo-msc_10.42.42.6(pid=11153): stderr: | [0;m[38;5;43m20221214045636007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045636007 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f279ca38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045636007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045636007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045636007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045636007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045636009 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045636010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045636010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045636010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:36.969116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Terminating (SIGTERM) 04:56:37.008722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Terminating (SIGTERM) 04:56:37.048439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11152): Terminating (SIGTERM) 04:56:37.088508 --- ParallelTerminationStrategy: PID 11146 died... 04:56:37.108002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Terminated: ok {rc=0} 04:56:37.152109 --- ParallelTerminationStrategy: PID 11149 died... 04:56:37.170837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Terminated: ok {rc=0} 04:56:37.214612 --- ParallelTerminationStrategy: PID 11152 died... 04:56:37.233423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11152): Terminated: ok {rc=0} 04:56:37.317279 bus /sierra_3: Setting Powered False 04:56:38.415598 bus /sierra_3: Setting Powered False 04:56:39.532546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:56:40.804493 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:40.810245 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:56:40.874681 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:56:40.902129 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:56:40.954834 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:56:41.020555 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:56:41.047919 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:56:41.595473 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:56:41.600845 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:41.612285 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:41.659511 tst handover.py: using LAC 38707 04:56:41.780403 tst handover.py: using RAC 202 04:56:41.903430 tst handover.py: using CellId 38707 04:56:42.026344 tst handover.py: using BVCI 38708 04:56:42.138600 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:56:42.190124 tst handover.py: using LAC 38708 04:56:42.312100 tst handover.py: using RAC 203 04:56:42.432429 tst handover.py: using CellId 38708 04:56:42.562456 tst handover.py: using BVCI 38709 04:56:42.683159 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:42.694633 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:42.706086 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:42.717438 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:42.729277 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:56:42.740504 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:42.861909 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:56:42.981854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:43.432483 run create_hlr_db(pid=11158): Launched 04:56:43.551076 bus /sierra_2: Setting Powered False 04:56:44.611695 run create_hlr_db(pid=11158): Terminated: ok {rc=0} 04:56:45.033211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11160): Launched 04:56:45.363059 run osmo-hlr_10.42.42.2(pid=11161): Launched 04:56:45.489278 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:46.059275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11163): Launched 04:56:46.405654 run osmo-stp_10.42.42.5(pid=11164): Launched 04:56:46.701817 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:47.337886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11166): Launched 04:56:47.649331 run osmo-msc_10.42.42.6(pid=11167): Launched 04:56:47.823109 run osmo-stp_10.42.42.5(pid=11164): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11164)] 04:56:47.955160 run osmo-stp_10.42.42.5(pid=11164): stdout: | (launched: 2022-12-14_04:56:46.340578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:48.086324 run osmo-stp_10.42.42.5(pid=11164): stderr: | [0;m[38;5;43m20221214045646598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045646598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045646599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045646599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045646599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045646599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045646600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:48.215262 run osmo-stp_10.42.42.5(pid=11164): stdout: | (launched: 2022-12-14_04:56:46.340578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:48.337807 run osmo-stp_10.42.42.5(pid=11164): stderr: | [0;m[38;5;43m20221214045646598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045646598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045646599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045646599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045646599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045646599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045646600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:48.484427 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11164): Process ended prematurely: osmo-stp_10.42.42.5(pid=11164) [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11164)] [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 04:56:48.493032 tst handover.py:18: Test FAILED (6.9 sec) 04:56:48.519333 run osmo-hlr_10.42.42.2(pid=11161): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11161)] 04:56:48.567945 run osmo-hlr_10.42.42.2(pid=11161): stdout: | (launched: 2022-12-14_04:56:45.302236) 04:56:48.617636 run osmo-hlr_10.42.42.2(pid=11161): stderr: | [0;m[1;31m20221214045645501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045645501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045645501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045645501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045645501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045645502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045645513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045645521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045645522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045645522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:48.687014 run osmo-msc_10.42.42.6(pid=11167): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11167)] 04:56:48.734508 run osmo-msc_10.42.42.6(pid=11167): stdout: | (launched: 2022-12-14_04:56:47.591614) 04:56:48.783934 run osmo-msc_10.42.42.6(pid=11167): stderr: | [0;m[38;5;43m20221214045647864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045647864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb3de8ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045647864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045647864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045647864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045647865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045647866 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045647867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045647867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045647867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:56:48.833567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11160): Terminating (SIGTERM) 04:56:48.873512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11163): Terminating (SIGTERM) 04:56:48.913298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11166): Terminating (SIGTERM) 04:56:48.953347 --- ParallelTerminationStrategy: PID 11160 died... 04:56:48.973007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11160): Terminated: ok {rc=0} 04:56:49.017384 --- ParallelTerminationStrategy: PID 11163 died... 04:56:49.036499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11163): Terminated: ok {rc=0} 04:56:49.080495 --- ParallelTerminationStrategy: PID 11166 died... 04:56:49.099724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11166): Terminated: ok {rc=0} 04:56:49.184555 bus /sierra_3: Setting Powered False 04:56:50.282746 bus /sierra_3: Setting Powered False 04:56:51.401049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 04:56:52.672860 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:56:52.678125 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:56:52.728863 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:56:52.755127 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:56:52.807875 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:56:52.861185 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:56:52.888622 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:56:53.430692 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 04:56:53.436131 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:53.446968 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:53.493583 tst handover.py: using LAC 38709 04:56:53.615840 tst handover.py: using RAC 204 04:56:53.731632 tst handover.py: using CellId 38709 04:56:53.857500 tst handover.py: using BVCI 38710 04:56:53.975689 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 04:56:54.011685 tst handover.py: using LAC 38710 04:56:54.136361 tst handover.py: using RAC 205 04:56:54.260017 tst handover.py: using CellId 38710 04:56:54.385347 tst handover.py: using BVCI 38711 04:56:54.501113 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:54.512134 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:54.523156 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:54.534464 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:54.545651 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:56:54.556571 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:54.673580 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 04:56:54.790777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:56:55.229437 run create_hlr_db(pid=11172): Launched 04:56:55.345428 bus /sierra_2: Setting Powered False 04:56:56.405639 run create_hlr_db(pid=11172): Terminated: ok {rc=0} 04:56:56.798750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Launched 04:56:57.099115 run osmo-hlr_10.42.42.2(pid=11175): Launched 04:56:57.214144 run osmo-stp_10.42.42.5: Starting osmo-stp 04:56:57.716674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Launched 04:56:58.015703 run osmo-stp_10.42.42.5(pid=11178): Launched 04:56:58.129460 run osmo-msc_10.42.42.6: Starting osmo-msc 04:56:58.644394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Launched 04:56:58.943859 run osmo-msc_10.42.42.6(pid=11181): Launched 04:56:59.111508 run osmo-stp_10.42.42.5(pid=11178): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] 04:56:59.238452 run osmo-stp_10.42.42.5(pid=11178): stdout: | (launched: 2022-12-14_04:56:57.960348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:59.365439 run osmo-stp_10.42.42.5(pid=11178): stderr: | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045658128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:59.490657 run osmo-stp_10.42.42.5(pid=11178): stdout: | (launched: 2022-12-14_04:56:57.960348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:56:59.610087 run osmo-stp_10.42.42.5(pid=11178): stderr: | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045658127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045658128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045658128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:56:59.752856 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11178): Process ended prematurely: osmo-stp_10.42.42.5(pid=11178) [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 04:56:59.761211 tst handover.py:18: Test FAILED (6.3 sec) 04:56:59.787292 run osmo-hlr_10.42.42.2(pid=11175): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11175)] 04:56:59.836622 run osmo-hlr_10.42.42.2(pid=11175): stdout: | (launched: 2022-12-14_04:56:57.043258) 04:56:59.887132 run osmo-hlr_10.42.42.2(pid=11175): stderr: | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045657217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045657229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045657237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045657238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045657238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:56:59.957392 run osmo-msc_10.42.42.6(pid=11181): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11181)] 04:57:00.004651 run osmo-msc_10.42.42.6(pid=11181): stdout: | (launched: 2022-12-14_04:56:58.888317) 04:57:00.054518 run osmo-msc_10.42.42.6(pid=11181): stderr: | [0;m[38;5;43m20221214045659155 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045659156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1632000c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045659156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045659156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045659156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045659156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045659158 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045659158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045659158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045659159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:00.104936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Terminating (SIGTERM) 04:57:00.145303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Terminating (SIGTERM) 04:57:00.185629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Terminating (SIGTERM) 04:57:00.226456 --- ParallelTerminationStrategy: PID 11174 died... 04:57:00.246452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Terminated: ok {rc=0} 04:57:00.291156 --- ParallelTerminationStrategy: PID 11177 died... 04:57:00.310547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Terminated: ok {rc=0} 04:57:00.355012 --- ParallelTerminationStrategy: PID 11180 died... 04:57:00.374486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Terminated: ok {rc=0} 04:57:00.461204 bus /sierra_3: Setting Powered False 04:57:01.565344 bus /sierra_3: Setting Powered False 04:57:02.688237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 04:57:03.946580 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:03.952302 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:57:04.015337 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:57:04.042186 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:57:04.095220 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:57:04.160607 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:57:04.187752 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:04.730517 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:04.736609 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:04.747820 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:04.795813 tst handover.py: using LAC 38711 04:57:04.920068 tst handover.py: using RAC 206 04:57:05.038458 tst handover.py: using CellId 38711 04:57:05.155523 tst handover.py: using BVCI 38712 04:57:05.264158 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:05.311781 tst handover.py: using LAC 38712 04:57:05.429411 tst handover.py: using RAC 207 04:57:05.555957 tst handover.py: using CellId 38712 04:57:05.681889 tst handover.py: using BVCI 38713 04:57:05.790837 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:05.801748 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:05.812432 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:05.822967 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:05.833397 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:05.844804 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:05.959879 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:06.077477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:06.540574 run create_hlr_db(pid=11186): Launched 04:57:06.669825 bus /sierra_2: Setting Powered False 04:57:07.732588 run create_hlr_db(pid=11186): Terminated: ok {rc=0} 04:57:08.130855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Launched 04:57:08.425308 run osmo-hlr_10.42.42.2(pid=11189): Launched 04:57:08.538309 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:09.030700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Launched 04:57:09.325373 run osmo-stp_10.42.42.5(pid=11192): Launched 04:57:09.437760 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:09.950458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Launched 04:57:10.246116 run osmo-msc_10.42.42.6(pid=11195): Launched 04:57:10.411652 run osmo-stp_10.42.42.5(pid=11192): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] 04:57:10.537372 run osmo-stp_10.42.42.5(pid=11192): stdout: | (launched: 2022-12-14_04:57:09.270516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:10.662920 run osmo-stp_10.42.42.5(pid=11192): stderr: | [0;m[38;5;43m20221214045709437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045709437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045709438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045709438 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:10.787076 run osmo-stp_10.42.42.5(pid=11192): stdout: | (launched: 2022-12-14_04:57:09.270516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:10.904745 run osmo-stp_10.42.42.5(pid=11192): stderr: | [0;m[38;5;43m20221214045709437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045709437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045709438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045709438 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045709439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:11.045510 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11192): Process ended prematurely: osmo-stp_10.42.42.5(pid=11192) [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 04:57:11.053845 tst handover.py:18: Test FAILED (6.3 sec) 04:57:11.079851 run osmo-hlr_10.42.42.2(pid=11189): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11189)] 04:57:11.127872 run osmo-hlr_10.42.42.2(pid=11189): stdout: | (launched: 2022-12-14_04:57:08.370849) 04:57:11.177429 run osmo-hlr_10.42.42.2(pid=11189): stderr: | [0;m[1;31m20221214045708541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045708541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045708541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045708541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045708542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045708542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045708555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045708563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045708564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045708564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:11.246316 run osmo-msc_10.42.42.6(pid=11195): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11195)] 04:57:11.293290 run osmo-msc_10.42.42.6(pid=11195): stdout: | (launched: 2022-12-14_04:57:10.191312) 04:57:11.342334 run osmo-msc_10.42.42.6(pid=11195): stderr: | [0;m[38;5;43m20221214045710459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045710459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb8d470c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045710459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045710459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045710459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045710459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045710461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045710462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045710462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045710462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:11.391879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Terminating (SIGTERM) 04:57:11.431639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Terminating (SIGTERM) 04:57:11.471431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Terminating (SIGTERM) 04:57:11.511777 --- ParallelTerminationStrategy: PID 11188 died... 04:57:11.531528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Terminated: ok {rc=0} 04:57:11.575659 --- ParallelTerminationStrategy: PID 11191 died... 04:57:11.594614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Terminated: ok {rc=0} 04:57:11.638504 --- ParallelTerminationStrategy: PID 11194 died... 04:57:11.657434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Terminated: ok {rc=0} 04:57:11.741103 bus /sierra_3: Setting Powered False 04:57:12.838487 bus /sierra_3: Setting Powered False 04:57:13.955544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 04:57:15.219493 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:15.224755 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:57:15.285584 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:57:15.311369 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:57:15.360701 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:57:15.421707 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:57:15.447538 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:57:16.019745 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 04:57:16.028232 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:16.043154 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:16.101720 tst handover.py: using LAC 38713 04:57:16.232086 tst handover.py: using RAC 208 04:57:16.383014 tst handover.py: using CellId 38713 04:57:16.503253 tst handover.py: using BVCI 38714 04:57:16.613918 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:57:16.661214 tst handover.py: using LAC 38714 04:57:16.779637 tst handover.py: using RAC 209 04:57:16.949760 tst handover.py: using CellId 38714 04:57:17.072524 tst handover.py: using BVCI 38715 04:57:17.182345 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:17.193671 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:17.204493 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:17.215834 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:17.227909 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:57:17.239789 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:17.357318 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:57:17.472669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:17.936602 run create_hlr_db(pid=11200): Launched 04:57:18.064152 bus /sierra_2: Setting Powered False 04:57:19.128142 run create_hlr_db(pid=11200): Terminated: ok {rc=0} 04:57:19.528175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11202): Launched 04:57:19.823571 run osmo-hlr_10.42.42.2(pid=11203): Launched 04:57:19.935654 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:20.433966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11205): Launched 04:57:20.728498 run osmo-stp_10.42.42.5(pid=11206): Launched 04:57:20.840683 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:21.348832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11208): Launched 04:57:21.644228 run osmo-msc_10.42.42.6(pid=11211): Launched 04:57:21.808277 run osmo-stp_10.42.42.5(pid=11206): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11206)] 04:57:21.934605 run osmo-stp_10.42.42.5(pid=11206): stdout: | (launched: 2022-12-14_04:57:20.672917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:22.059503 run osmo-stp_10.42.42.5(pid=11206): stderr: | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045720838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:22.182314 run osmo-stp_10.42.42.5(pid=11206): stdout: | (launched: 2022-12-14_04:57:20.672917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:22.299207 run osmo-stp_10.42.42.5(pid=11206): stderr: | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045720838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045720838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045720839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:22.439204 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11206): Process ended prematurely: osmo-stp_10.42.42.5(pid=11206) [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11206)] [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 04:57:22.447432 tst handover.py:18: Test FAILED (6.4 sec) 04:57:22.473025 run osmo-hlr_10.42.42.2(pid=11203): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11203)] 04:57:22.520433 run osmo-hlr_10.42.42.2(pid=11203): stdout: | (launched: 2022-12-14_04:57:19.769099) 04:57:22.569239 run osmo-hlr_10.42.42.2(pid=11203): stderr: | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045719941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045719953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045719962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045719962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045719962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:22.637704 run osmo-msc_10.42.42.6(pid=11211): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11211)] 04:57:22.684512 run osmo-msc_10.42.42.6(pid=11211): stdout: | (launched: 2022-12-14_04:57:21.589292) 04:57:22.733800 run osmo-msc_10.42.42.6(pid=11211): stderr: | [0;m[38;5;43m20221214045721856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045721857 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7fc18d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045721857 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045721857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045721857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045721857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045721859 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045721859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045721859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045721859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:22.782970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11202): Terminating (SIGTERM) 04:57:22.822379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11205): Terminating (SIGTERM) 04:57:22.862047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11208): Terminating (SIGTERM) 04:57:22.902118 --- ParallelTerminationStrategy: PID 11202 died... 04:57:22.921468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11202): Terminated: ok {rc=0} 04:57:22.965376 --- ParallelTerminationStrategy: PID 11205 died... 04:57:22.983976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11205): Terminated: ok {rc=0} 04:57:23.027847 --- ParallelTerminationStrategy: PID 11208 died... 04:57:23.046542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11208): Terminated: ok {rc=0} 04:57:23.132234 bus /sierra_3: Setting Powered False 04:57:24.231620 bus /sierra_3: Setting Powered False 04:57:25.347024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 04:57:26.611535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:26.616816 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 04:57:26.674820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 04:57:26.700559 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 04:57:26.751041 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 04:57:26.809593 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 04:57:26.835587 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 04:57:27.388743 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 04:57:27.393837 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:27.404783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:57:27.448023 tst handover.py: using LAC 38715 04:57:27.563999 tst handover.py: using RAC 210 04:57:27.679709 tst handover.py: using CellId 38715 04:57:27.794628 tst handover.py: using BVCI 38716 04:57:27.903234 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 04:57:27.951842 tst handover.py: using LAC 38716 04:57:28.075972 tst handover.py: using RAC 211 04:57:28.199054 tst handover.py: using CellId 38716 04:57:28.315364 tst handover.py: using BVCI 38717 04:57:28.431601 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:28.443311 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:28.454815 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:28.466357 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:28.477954 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 04:57:28.489545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:57:28.608434 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 04:57:28.724279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:29.156864 run create_hlr_db(pid=11216): Launched 04:57:29.269576 bus /sierra_2: Setting Powered False 04:57:30.328811 run create_hlr_db(pid=11216): Terminated: ok {rc=0} 04:57:30.735513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11218): Launched 04:57:31.100686 run osmo-hlr_10.42.42.2(pid=11219): Launched 04:57:31.278401 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:31.940763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11221): Launched 04:57:32.305666 run osmo-stp_10.42.42.5(pid=11222): Launched 04:57:32.444048 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:32.999087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11224): Launched 04:57:33.320660 run osmo-msc_10.42.42.6(pid=11225): Launched 04:57:33.499617 run osmo-stp_10.42.42.5(pid=11222): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11222)] 04:57:33.635037 run osmo-stp_10.42.42.5(pid=11222): stdout: | (launched: 2022-12-14_04:57:32.239005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:33.770651 run osmo-stp_10.42.42.5(pid=11222): stderr: | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045732465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:33.905593 run osmo-stp_10.42.42.5(pid=11222): stdout: | (launched: 2022-12-14_04:57:32.239005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:34.041613 run osmo-stp_10.42.42.5(pid=11222): stderr: | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045732464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045732465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045732465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:34.193827 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11222): Process ended prematurely: osmo-stp_10.42.42.5(pid=11222) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11222)] [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 04:57:34.202917 tst handover.py:18: Test FAILED (6.8 sec) 04:57:34.230434 run osmo-hlr_10.42.42.2(pid=11219): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11219)] 04:57:34.280741 run osmo-hlr_10.42.42.2(pid=11219): stdout: | (launched: 2022-12-14_04:57:31.029176) 04:57:34.333080 run osmo-hlr_10.42.42.2(pid=11219): stderr: | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045731404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045731423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045731439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045731439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045731439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:34.406198 run osmo-msc_10.42.42.6(pid=11225): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11225)] 04:57:34.456439 run osmo-msc_10.42.42.6(pid=11225): stdout: | (launched: 2022-12-14_04:57:33.261391) 04:57:34.508411 run osmo-msc_10.42.42.6(pid=11225): stderr: | [0;m[38;5;43m20221214045733583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045733583 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f63eb30bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045733583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045733584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045733584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045733584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045733586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045733586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045733586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045733586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:34.560871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11218): Terminating (SIGTERM) 04:57:34.602760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11221): Terminating (SIGTERM) 04:57:34.644346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11224): Terminating (SIGTERM) 04:57:34.686427 --- ParallelTerminationStrategy: PID 11218 died... 04:57:34.706819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11218): Terminated: ok {rc=0} 04:57:34.753382 --- ParallelTerminationStrategy: PID 11221 died... 04:57:34.773167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11221): Terminated: ok {rc=0} 04:57:34.819384 --- ParallelTerminationStrategy: PID 11224 died... 04:57:34.839116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11224): Terminated: ok {rc=0} 04:57:34.926874 bus /sierra_3: Setting Powered False 04:57:36.025521 bus /sierra_3: Setting Powered False 04:57:37.141466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 04:57:38.405713 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:38.411138 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:57:38.458277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:57:38.484381 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:57:38.534970 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:57:38.581189 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:57:38.607222 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:57:39.159448 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 04:57:39.164434 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:39.175309 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:39.221523 tst handover.py: using LAC 38717 04:57:39.360610 tst handover.py: using RAC 212 04:57:39.486966 tst handover.py: using CellId 38717 04:57:39.617367 tst handover.py: using BVCI 38718 04:57:39.734598 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 04:57:39.769128 tst handover.py: using LAC 38718 04:57:39.892112 tst handover.py: using RAC 213 04:57:40.014799 tst handover.py: using CellId 38718 04:57:40.130502 tst handover.py: using BVCI 38719 04:57:40.238708 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:40.249624 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:40.260211 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:40.270940 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:40.282409 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:57:40.293992 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:40.413322 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 04:57:40.529980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:40.964700 run create_hlr_db(pid=11230): Launched 04:57:41.077531 bus /sierra_2: Setting Powered False 04:57:42.137113 run create_hlr_db(pid=11230): Terminated: ok {rc=0} 04:57:42.546548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Launched 04:57:42.866142 run osmo-hlr_10.42.42.2(pid=11233): Launched 04:57:42.986842 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:43.508222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Launched 04:57:43.826660 run osmo-stp_10.42.42.5(pid=11236): Launched 04:57:43.947099 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:44.496121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Launched 04:57:44.814422 run osmo-msc_10.42.42.6(pid=11239): Launched 04:57:44.990671 run osmo-stp_10.42.42.5(pid=11236): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] 04:57:45.124594 run osmo-stp_10.42.42.5(pid=11236): stdout: | (launched: 2022-12-14_04:57:43.768209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:45.258901 run osmo-stp_10.42.42.5(pid=11236): stderr: | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045743957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045743957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045743958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045743958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:45.392878 run osmo-stp_10.42.42.5(pid=11236): stdout: | (launched: 2022-12-14_04:57:43.768209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:45.519766 run osmo-stp_10.42.42.5(pid=11236): stderr: | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045743956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045743957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045743957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045743958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045743958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:45.671673 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11236): Process ended prematurely: osmo-stp_10.42.42.5(pid=11236) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 04:57:45.680558 tst handover.py:18: Test FAILED (6.5 sec) 04:57:45.707676 run osmo-hlr_10.42.42.2(pid=11233): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11233)] 04:57:45.757167 run osmo-hlr_10.42.42.2(pid=11233): stdout: | (launched: 2022-12-14_04:57:42.807701) 04:57:45.808153 run osmo-hlr_10.42.42.2(pid=11233): stderr: | [0;m[1;31m20221214045743000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045743000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045743001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045743027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045743036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045743036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045743037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:45.897822 run osmo-msc_10.42.42.6(pid=11239): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11239)] 04:57:45.948352 run osmo-msc_10.42.42.6(pid=11239): stdout: | (launched: 2022-12-14_04:57:44.756068) 04:57:46.000382 run osmo-msc_10.42.42.6(pid=11239): stderr: | [0;m[38;5;43m20221214045745072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045745072 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f66630eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045745072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045745072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045745073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045745073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045745074 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045745075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045745075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045745075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:46.052677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Terminating (SIGTERM) 04:57:46.095903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Terminating (SIGTERM) 04:57:46.141820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Terminating (SIGTERM) 04:57:46.186783 --- ParallelTerminationStrategy: PID 11232 died... 04:57:46.208344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11232): Terminated: ok {rc=0} 04:57:46.257404 --- ParallelTerminationStrategy: PID 11235 died... 04:57:46.278397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11235): Terminated: ok {rc=0} 04:57:46.325442 --- ParallelTerminationStrategy: PID 11238 died... 04:57:46.347665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11238): Terminated: ok {rc=0} 04:57:46.436258 bus /sierra_3: Setting Powered False 04:57:47.530708 bus /sierra_3: Setting Powered False 04:57:48.644602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 04:57:49.892845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:57:49.897967 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:57:49.956344 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:57:49.982328 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:57:50.033197 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:57:50.091516 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:57:50.117528 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:57:50.669816 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 04:57:50.674819 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:50.685833 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:50.729289 tst handover.py: using LAC 38719 04:57:50.845355 tst handover.py: using RAC 214 04:57:50.963075 tst handover.py: using CellId 38719 04:57:51.079433 tst handover.py: using BVCI 38720 04:57:51.186974 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:57:51.235102 tst handover.py: using LAC 38720 04:57:51.354296 tst handover.py: using RAC 215 04:57:51.472936 tst handover.py: using CellId 38720 04:57:51.591796 tst handover.py: using BVCI 38721 04:57:51.699608 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:51.710609 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:51.721399 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:51.732188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:51.743775 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:57:51.755414 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:51.875572 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:57:51.992526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:57:52.428544 run create_hlr_db(pid=11244): Launched 04:57:52.541527 bus /sierra_2: Setting Powered False 04:57:53.601465 run create_hlr_db(pid=11244): Terminated: ok {rc=0} 04:57:53.992654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Launched 04:57:54.291222 run osmo-hlr_10.42.42.2(pid=11247): Launched 04:57:54.404013 run osmo-stp_10.42.42.5: Starting osmo-stp 04:57:54.902538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Launched 04:57:55.199105 run osmo-stp_10.42.42.5(pid=11250): Launched 04:57:55.311530 run osmo-msc_10.42.42.6: Starting osmo-msc 04:57:55.823109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Launched 04:57:56.119534 run osmo-msc_10.42.42.6(pid=11253): Launched 04:57:56.284221 run osmo-stp_10.42.42.5(pid=11250): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] 04:57:56.410688 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-14_04:57:55.143970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:56.536195 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045755311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:56.659902 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-14_04:57:55.143970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:57:56.778082 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045755311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045755311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045755312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:57:56.918616 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 04:57:56.926899 tst handover.py:18: Test FAILED (6.2 sec) 04:57:56.952639 run osmo-hlr_10.42.42.2(pid=11247): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11247)] 04:57:57.000220 run osmo-hlr_10.42.42.2(pid=11247): stdout: | (launched: 2022-12-14_04:57:54.236152) 04:57:57.049289 run osmo-hlr_10.42.42.2(pid=11247): stderr: | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045754408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045754420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045754428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045754429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045754429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:57:57.118045 run osmo-msc_10.42.42.6(pid=11253): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11253)] 04:57:57.164571 run osmo-msc_10.42.42.6(pid=11253): stdout: | (launched: 2022-12-14_04:57:56.064579) 04:57:57.213197 run osmo-msc_10.42.42.6(pid=11253): stderr: | [0;m[38;5;43m20221214045756334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045756334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8258af4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045756334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045756334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045756334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045756335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045756336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045756337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045756337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045756337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:57:57.262174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminating (SIGTERM) 04:57:57.301231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminating (SIGTERM) 04:57:57.340469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminating (SIGTERM) 04:57:57.379973 --- ParallelTerminationStrategy: PID 11246 died... 04:57:57.399180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminated: ok {rc=0} 04:57:57.442967 --- ParallelTerminationStrategy: PID 11249 died... 04:57:57.461634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminated: ok {rc=0} 04:57:57.505126 --- ParallelTerminationStrategy: PID 11252 died... 04:57:57.523793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11252): Terminated: ok {rc=0} 04:57:57.610029 bus /sierra_3: Setting Powered False 04:57:58.708517 bus /sierra_3: Setting Powered False 04:57:59.823469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:01.121079 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:01.128457 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:01.200272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:01.233743 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:01.294275 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:01.374595 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:01.406470 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:01.954284 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:01.961978 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:01.975817 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:02.029111 tst handover.py: using LAC 38721 04:58:02.179862 tst handover.py: using RAC 216 04:58:02.347432 tst handover.py: using CellId 38721 04:58:02.480094 tst handover.py: using BVCI 38722 04:58:02.598603 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:02.646204 tst handover.py: using LAC 38722 04:58:02.770145 tst handover.py: using RAC 217 04:58:02.893713 tst handover.py: using CellId 38722 04:58:03.017483 tst handover.py: using BVCI 38723 04:58:03.135775 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:03.147350 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:03.158492 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:03.169785 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:03.181536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:03.193297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:03.308183 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:03.425601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:03.893783 run create_hlr_db(pid=11258): Launched 04:58:04.023695 bus /sierra_2: Setting Powered False 04:58:05.086430 run create_hlr_db(pid=11258): Terminated: ok {rc=0} 04:58:05.487749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Launched 04:58:05.785479 run osmo-hlr_10.42.42.2(pid=11261): Launched 04:58:05.898314 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:06.389658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Launched 04:58:06.689050 run osmo-stp_10.42.42.5(pid=11264): Launched 04:58:06.802093 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:07.312908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Launched 04:58:07.609685 run osmo-msc_10.42.42.6(pid=11267): Launched 04:58:07.775489 run osmo-stp_10.42.42.5(pid=11264): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] 04:58:07.900569 run osmo-stp_10.42.42.5(pid=11264): stdout: | (launched: 2022-12-14_04:58:06.633731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:08.025366 run osmo-stp_10.42.42.5(pid=11264): stderr: | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045806802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045806802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045806802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045806803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:08.148448 run osmo-stp_10.42.42.5(pid=11264): stdout: | (launched: 2022-12-14_04:58:06.633731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:08.265564 run osmo-stp_10.42.42.5(pid=11264): stderr: | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045806801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045806802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045806802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045806802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045806803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:08.405764 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11264): Process ended prematurely: osmo-stp_10.42.42.5(pid=11264) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 04:58:08.414542 tst handover.py:18: Test FAILED (6.4 sec) 04:58:08.440919 run osmo-hlr_10.42.42.2(pid=11261): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11261)] 04:58:08.489294 run osmo-hlr_10.42.42.2(pid=11261): stdout: | (launched: 2022-12-14_04:58:05.730579) 04:58:08.538413 run osmo-hlr_10.42.42.2(pid=11261): stderr: | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045805902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045805914 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045805923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045805923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045805923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:08.607238 run osmo-msc_10.42.42.6(pid=11267): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11267)] 04:58:08.654324 run osmo-msc_10.42.42.6(pid=11267): stdout: | (launched: 2022-12-14_04:58:07.554692) 04:58:08.703166 run osmo-msc_10.42.42.6(pid=11267): stderr: | [0;m[38;5;43m20221214045807822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045807823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa4919dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045807823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045807823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045807823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045807823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045807825 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045807825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045807826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045807826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:08.752505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Terminating (SIGTERM) 04:58:08.791661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Terminating (SIGTERM) 04:58:08.830965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Terminating (SIGTERM) 04:58:08.870267 --- ParallelTerminationStrategy: PID 11260 died... 04:58:08.889556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11260): Terminated: ok {rc=0} 04:58:08.933082 --- ParallelTerminationStrategy: PID 11263 died... 04:58:08.951668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11263): Terminated: ok {rc=0} 04:58:08.994938 --- ParallelTerminationStrategy: PID 11266 died... 04:58:09.013631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11266): Terminated: ok {rc=0} 04:58:09.099367 bus /sierra_3: Setting Powered False 04:58:10.198587 bus /sierra_3: Setting Powered False 04:58:11.313087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 04:58:12.577952 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:12.584330 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 04:58:12.636416 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 04:58:12.663617 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 04:58:12.717068 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 04:58:12.768095 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 04:58:12.794435 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 04:58:13.351042 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 04:58:13.357469 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:13.369484 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:58:13.417939 tst handover.py: using LAC 38723 04:58:13.541694 tst handover.py: using RAC 218 04:58:13.659020 tst handover.py: using CellId 38723 04:58:13.775521 tst handover.py: using BVCI 38724 04:58:13.883741 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 04:58:13.917213 tst handover.py: using LAC 38724 04:58:14.033107 tst handover.py: using RAC 219 04:58:14.157404 tst handover.py: using CellId 38724 04:58:14.280491 tst handover.py: using BVCI 38725 04:58:14.396021 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:14.407297 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:14.418461 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:14.429515 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:14.440614 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 04:58:14.451812 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:58:14.568368 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 04:58:14.682912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:15.119009 run create_hlr_db(pid=11272): Launched 04:58:15.232226 bus /sierra_2: Setting Powered False 04:58:16.305208 run create_hlr_db(pid=11272): Terminated: ok {rc=0} 04:58:16.784236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11274): Launched 04:58:17.102762 run osmo-hlr_10.42.42.2(pid=11275): Launched 04:58:17.365499 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:17.884771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11277): Launched 04:58:18.202568 run osmo-stp_10.42.42.5(pid=11278): Launched 04:58:18.322851 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:18.873596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11280): Launched 04:58:19.192805 run osmo-msc_10.42.42.6(pid=11281): Launched 04:58:19.369389 run osmo-stp_10.42.42.5(pid=11278): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11278)] 04:58:19.503108 run osmo-stp_10.42.42.5(pid=11278): stdout: | (launched: 2022-12-14_04:58:18.144349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:19.638035 run osmo-stp_10.42.42.5(pid=11278): stderr: | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045818331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:19.771513 run osmo-stp_10.42.42.5(pid=11278): stdout: | (launched: 2022-12-14_04:58:18.144349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:19.897916 run osmo-stp_10.42.42.5(pid=11278): stderr: | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045818331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045818331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045818332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:20.049029 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11278): Process ended prematurely: osmo-stp_10.42.42.5(pid=11278) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11278)] [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 04:58:20.057767 tst handover.py:18: Test FAILED (6.7 sec) 04:58:20.084789 run osmo-hlr_10.42.42.2(pid=11275): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11275)] 04:58:20.133968 run osmo-hlr_10.42.42.2(pid=11275): stdout: | (launched: 2022-12-14_04:58:17.044680) 04:58:20.185115 run osmo-hlr_10.42.42.2(pid=11275): stderr: | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045817262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045817276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045817288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045817289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045817289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:20.256251 run osmo-msc_10.42.42.6(pid=11281): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11281)] 04:58:20.305482 run osmo-msc_10.42.42.6(pid=11281): stdout: | (launched: 2022-12-14_04:58:19.134122) 04:58:20.356511 run osmo-msc_10.42.42.6(pid=11281): stderr: | [0;m[38;5;43m20221214045819454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045819454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fafde52ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045819454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045819454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045819454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045819454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045819456 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045819456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045819456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045819456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:20.407883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11274): Terminating (SIGTERM) 04:58:20.449060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11277): Terminating (SIGTERM) 04:58:20.490128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11280): Terminating (SIGTERM) 04:58:20.531532 --- ParallelTerminationStrategy: PID 11274 died... 04:58:20.551456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11274): Terminated: ok {rc=0} 04:58:20.597523 --- ParallelTerminationStrategy: PID 11277 died... 04:58:20.616636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11277): Terminated: ok {rc=0} 04:58:20.662686 --- ParallelTerminationStrategy: PID 11280 died... 04:58:20.682626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11280): Terminated: ok {rc=0} 04:58:20.770104 bus /sierra_3: Setting Powered False 04:58:21.868082 bus /sierra_3: Setting Powered False 04:58:22.986299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 04:58:24.240808 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:24.246518 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:58:24.309695 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:58:24.335714 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:58:24.386994 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:58:24.452594 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:58:24.478773 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:58:25.026514 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 04:58:25.032012 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:25.043114 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:25.091195 tst handover.py: using LAC 38725 04:58:25.208471 tst handover.py: using RAC 220 04:58:25.325357 tst handover.py: using CellId 38725 04:58:25.443648 tst handover.py: using BVCI 38726 04:58:25.553869 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:25.601144 tst handover.py: using LAC 38726 04:58:25.718099 tst handover.py: using RAC 221 04:58:25.838890 tst handover.py: using CellId 38726 04:58:25.955189 tst handover.py: using BVCI 38727 04:58:26.063003 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:26.073982 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:26.084518 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:26.095205 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:26.106235 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:26.117268 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:26.236657 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:26.351786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:26.788273 run create_hlr_db(pid=11286): Launched 04:58:26.901632 bus /sierra_2: Setting Powered False 04:58:27.961362 run create_hlr_db(pid=11286): Terminated: ok {rc=0} 04:58:28.370461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Launched 04:58:28.689993 run osmo-hlr_10.42.42.2(pid=11289): Launched 04:58:28.810470 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:29.308842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Launched 04:58:29.608235 run osmo-stp_10.42.42.5(pid=11292): Launched 04:58:29.721909 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:30.235787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11294): Launched 04:58:30.533045 run osmo-msc_10.42.42.6(pid=11295): Launched 04:58:30.699396 run osmo-stp_10.42.42.5(pid=11292): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] 04:58:30.825984 run osmo-stp_10.42.42.5(pid=11292): stdout: | (launched: 2022-12-14_04:58:29.552857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:31.023816 run osmo-stp_10.42.42.5(pid=11292): stderr: | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045829720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045829720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045829721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045829721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:31.153221 run osmo-stp_10.42.42.5(pid=11292): stdout: | (launched: 2022-12-14_04:58:29.552857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:31.275594 run osmo-stp_10.42.42.5(pid=11292): stderr: | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045829719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045829720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045829720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045829721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045829721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:31.420738 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11292): Process ended prematurely: osmo-stp_10.42.42.5(pid=11292) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 04:58:31.430104 tst handover.py:18: Test FAILED (6.4 sec) 04:58:31.457328 run osmo-hlr_10.42.42.2(pid=11289): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11289)] 04:58:31.507812 run osmo-hlr_10.42.42.2(pid=11289): stdout: | (launched: 2022-12-14_04:58:28.631294) 04:58:31.558761 run osmo-hlr_10.42.42.2(pid=11289): stderr: | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045828825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045828837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045828845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045828846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045828846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:31.630598 run osmo-msc_10.42.42.6(pid=11295): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11295)] 04:58:31.679372 run osmo-msc_10.42.42.6(pid=11295): stdout: | (launched: 2022-12-14_04:58:30.477799) 04:58:31.730065 run osmo-msc_10.42.42.6(pid=11295): stderr: | [0;m[38;5;43m20221214045830746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045830746 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ba3e27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045830746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045830746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045830746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045830746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045830748 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045830749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045830749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045830749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:31.781882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Terminating (SIGTERM) 04:58:31.824044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Terminating (SIGTERM) 04:58:31.867076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11294): Terminating (SIGTERM) 04:58:31.909396 --- ParallelTerminationStrategy: PID 11288 died... 04:58:31.929790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Terminated: ok {rc=0} 04:58:31.975606 --- ParallelTerminationStrategy: PID 11291 died... 04:58:31.996246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Terminated: ok {rc=0} 04:58:32.042092 --- ParallelTerminationStrategy: PID 11294 died... 04:58:32.062591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11294): Terminated: ok {rc=0} 04:58:32.148702 bus /sierra_3: Setting Powered False 04:58:33.247556 bus /sierra_3: Setting Powered False 04:58:34.362874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:35.637400 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:35.643068 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:35.707253 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:35.734473 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:35.787807 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:35.854211 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:35.881802 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:36.430862 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:36.436859 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:36.448757 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:36.497203 tst handover.py: using LAC 38727 04:58:36.613634 tst handover.py: using RAC 222 04:58:36.740314 tst handover.py: using CellId 38727 04:58:36.858106 tst handover.py: using BVCI 38728 04:58:36.966067 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:37.013717 tst handover.py: using LAC 38728 04:58:37.133688 tst handover.py: using RAC 223 04:58:37.259972 tst handover.py: using CellId 38728 04:58:37.389709 tst handover.py: using BVCI 38729 04:58:37.506665 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:37.518291 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:37.529736 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:37.541178 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:37.552451 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:37.563711 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:37.685071 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:58:37.800859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:38.236915 run create_hlr_db(pid=11300): Launched 04:58:38.350962 bus /sierra_2: Setting Powered False 04:58:39.410678 run create_hlr_db(pid=11300): Terminated: ok {rc=0} 04:58:39.800231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11302): Launched 04:58:40.097141 run osmo-hlr_10.42.42.2(pid=11303): Launched 04:58:40.209686 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:40.706747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11305): Launched 04:58:41.002805 run osmo-stp_10.42.42.5(pid=11306): Launched 04:58:41.114747 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:41.624078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11308): Launched 04:58:41.921082 run osmo-msc_10.42.42.6(pid=11309): Launched 04:58:42.085186 run osmo-stp_10.42.42.5(pid=11306): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11306)] 04:58:42.210797 run osmo-stp_10.42.42.5(pid=11306): stdout: | (launched: 2022-12-14_04:58:40.947832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:42.336626 run osmo-stp_10.42.42.5(pid=11306): stderr: | [0;m[38;5;43m20221214045841114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045841115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045841115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045841115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:42.461718 run osmo-stp_10.42.42.5(pid=11306): stdout: | (launched: 2022-12-14_04:58:40.947832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:42.579258 run osmo-stp_10.42.42.5(pid=11306): stderr: | [0;m[38;5;43m20221214045841114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045841115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045841115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045841115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045841116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:42.720247 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11306): Process ended prematurely: osmo-stp_10.42.42.5(pid=11306) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11306)] [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 04:58:42.728663 tst handover.py:18: Test FAILED (6.3 sec) 04:58:42.754432 run osmo-hlr_10.42.42.2(pid=11303): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11303)] 04:58:42.802009 run osmo-hlr_10.42.42.2(pid=11303): stdout: | (launched: 2022-12-14_04:58:40.042139) 04:58:42.850808 run osmo-hlr_10.42.42.2(pid=11303): stderr: | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045840214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045840226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045840237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045840237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045840237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:42.919380 run osmo-msc_10.42.42.6(pid=11309): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11309)] 04:58:42.966079 run osmo-msc_10.42.42.6(pid=11309): stdout: | (launched: 2022-12-14_04:58:41.865326) 04:58:43.014963 run osmo-msc_10.42.42.6(pid=11309): stderr: | [0;m[38;5;43m20221214045842134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045842135 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bd45a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045842135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045842135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045842135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045842135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045842137 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045842137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045842137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045842137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:43.064088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11302): Terminating (SIGTERM) 04:58:43.103338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11305): Terminating (SIGTERM) 04:58:43.142500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11308): Terminating (SIGTERM) 04:58:43.181939 --- ParallelTerminationStrategy: PID 11302 died... 04:58:43.201244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11302): Terminated: ok {rc=0} 04:58:43.245083 --- ParallelTerminationStrategy: PID 11305 died... 04:58:43.263918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11305): Terminated: ok {rc=0} 04:58:43.307439 --- ParallelTerminationStrategy: PID 11308 died... 04:58:43.326155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11308): Terminated: ok {rc=0} 04:58:43.411458 bus /sierra_3: Setting Powered False 04:58:44.508393 bus /sierra_3: Setting Powered False 04:58:45.622656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 04:58:46.900597 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:46.913330 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 04:58:46.991234 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 04:58:47.026427 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 04:58:47.090455 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 04:58:47.143749 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 04:58:47.170931 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 04:58:47.724204 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 04:58:47.729978 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:47.741366 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:47.775458 tst handover.py: using LAC 38729 04:58:47.894221 tst handover.py: using RAC 224 04:58:48.012069 tst handover.py: using CellId 38729 04:58:48.128620 tst handover.py: using BVCI 38730 04:58:48.245891 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 04:58:48.294619 tst handover.py: using LAC 38730 04:58:48.421430 tst handover.py: using RAC 225 04:58:48.548569 tst handover.py: using CellId 38730 04:58:48.673279 tst handover.py: using BVCI 38731 04:58:48.788230 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:48.799497 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:48.810558 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:48.821532 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:48.832505 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 04:58:48.843546 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:48.959700 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 04:58:49.076337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:58:49.544468 run create_hlr_db(pid=11314): Launched 04:58:49.674073 bus /sierra_2: Setting Powered False 04:58:50.737713 run create_hlr_db(pid=11314): Terminated: ok {rc=0} 04:58:51.142819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11316): Launched 04:58:51.443541 run osmo-hlr_10.42.42.2(pid=11317): Launched 04:58:51.558256 run osmo-stp_10.42.42.5: Starting osmo-stp 04:58:52.066035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11319): Launched 04:58:52.366700 run osmo-stp_10.42.42.5(pid=11320): Launched 04:58:52.481267 run osmo-msc_10.42.42.6: Starting osmo-msc 04:58:52.999813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11322): Launched 04:58:53.300588 run osmo-msc_10.42.42.6(pid=11323): Launched 04:58:53.468403 run osmo-stp_10.42.42.5(pid=11320): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11320)] 04:58:53.596685 run osmo-stp_10.42.42.5(pid=11320): stdout: | (launched: 2022-12-14_04:58:52.310900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:53.724015 run osmo-stp_10.42.42.5(pid=11320): stderr: | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045852478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:53.849320 run osmo-stp_10.42.42.5(pid=11320): stdout: | (launched: 2022-12-14_04:58:52.310900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:58:53.968682 run osmo-stp_10.42.42.5(pid=11320): stderr: | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045852477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045852478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045852478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:58:54.111573 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11320): Process ended prematurely: osmo-stp_10.42.42.5(pid=11320) [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11320)] [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 04:58:54.120088 tst handover.py:18: Test FAILED (6.4 sec) 04:58:54.146171 run osmo-hlr_10.42.42.2(pid=11317): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11317)] 04:58:54.194176 run osmo-hlr_10.42.42.2(pid=11317): stdout: | (launched: 2022-12-14_04:58:51.388367) 04:58:54.243411 run osmo-hlr_10.42.42.2(pid=11317): stderr: | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045851572 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045851581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045851581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045851581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:58:54.312486 run osmo-msc_10.42.42.6(pid=11323): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11323)] 04:58:54.359836 run osmo-msc_10.42.42.6(pid=11323): stdout: | (launched: 2022-12-14_04:58:53.244633) 04:58:54.409053 run osmo-msc_10.42.42.6(pid=11323): stderr: | [0;m[38;5;43m20221214045853513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045853513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0df0039c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045853513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045853513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045853513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045853514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045853515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045853516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045853516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045853516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:58:54.458725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11316): Terminating (SIGTERM) 04:58:54.498400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11319): Terminating (SIGTERM) 04:58:54.538378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11322): Terminating (SIGTERM) 04:58:54.578416 --- ParallelTerminationStrategy: PID 11316 died... 04:58:54.597863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11316): Terminated: ok {rc=0} 04:58:54.641795 --- ParallelTerminationStrategy: PID 11319 died... 04:58:54.660558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11319): Terminated: ok {rc=0} 04:58:54.705082 --- ParallelTerminationStrategy: PID 11322 died... 04:58:54.724142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11322): Terminated: ok {rc=0} 04:58:54.810366 bus /sierra_3: Setting Powered False 04:58:55.909307 bus /sierra_3: Setting Powered False 04:58:57.024339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 04:58:58.280815 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:58:58.285943 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:58:58.335995 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:58:58.362209 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:58:58.414121 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:58:58.465397 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:58:58.492396 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:58:59.039392 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 04:58:59.044455 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:58:59.055338 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:59.088720 tst handover.py: using LAC 38731 04:58:59.216850 tst handover.py: using RAC 226 04:58:59.343543 tst handover.py: using CellId 38731 04:58:59.471818 tst handover.py: using BVCI 38732 04:58:59.591138 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:58:59.643108 tst handover.py: using LAC 38732 04:58:59.768707 tst handover.py: using RAC 227 04:58:59.893353 tst handover.py: using CellId 38732 04:59:00.018449 tst handover.py: using BVCI 38733 04:59:00.136714 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:00.148055 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:00.159068 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:00.170111 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:00.181825 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:00.193530 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:00.310818 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:00.426544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:59:00.894576 run create_hlr_db(pid=11328): Launched 04:59:01.036784 bus /sierra_2: Setting Powered False 04:59:02.097098 run create_hlr_db(pid=11328): Terminated: ok {rc=0} 04:59:02.499048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Launched 04:59:02.801178 run osmo-hlr_10.42.42.2(pid=11331): Launched 04:59:02.914716 run osmo-stp_10.42.42.5: Starting osmo-stp 04:59:03.405013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Launched 04:59:03.704053 run osmo-stp_10.42.42.5(pid=11334): Launched 04:59:03.818389 run osmo-msc_10.42.42.6: Starting osmo-msc 04:59:04.335935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11336): Launched 04:59:04.636537 run osmo-msc_10.42.42.6(pid=11337): Launched 04:59:04.803847 run osmo-stp_10.42.42.5(pid=11334): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] 04:59:04.931402 run osmo-stp_10.42.42.5(pid=11334): stdout: | (launched: 2022-12-14_04:59:03.649083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:05.058379 run osmo-stp_10.42.42.5(pid=11334): stderr: | [0;m[38;5;43m20221214045903816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045903816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045903817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045903817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:05.183746 run osmo-stp_10.42.42.5(pid=11334): stdout: | (launched: 2022-12-14_04:59:03.649083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:05.302884 run osmo-stp_10.42.42.5(pid=11334): stderr: | [0;m[38;5;43m20221214045903816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045903816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045903817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045903817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045903818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:05.445676 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11334): Process ended prematurely: osmo-stp_10.42.42.5(pid=11334) [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 04:59:05.453931 tst handover.py:18: Test FAILED (6.4 sec) 04:59:05.479715 run osmo-hlr_10.42.42.2(pid=11331): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11331)] 04:59:05.527866 run osmo-hlr_10.42.42.2(pid=11331): stdout: | (launched: 2022-12-14_04:59:02.746024) 04:59:05.576892 run osmo-hlr_10.42.42.2(pid=11331): stderr: | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045902918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045902930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045902939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045902939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045902939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:59:05.645989 run osmo-msc_10.42.42.6(pid=11337): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11337)] 04:59:05.693330 run osmo-msc_10.42.42.6(pid=11337): stdout: | (launched: 2022-12-14_04:59:04.580888) 04:59:05.742431 run osmo-msc_10.42.42.6(pid=11337): stderr: | [0;m[38;5;43m20221214045904849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045904849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b47a51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045904849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045904849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045904849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045904849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045904851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045904851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045904852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045904852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:59:05.791680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Terminating (SIGTERM) 04:59:05.831342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Terminating (SIGTERM) 04:59:05.870849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11336): Terminating (SIGTERM) 04:59:05.911161 --- ParallelTerminationStrategy: PID 11330 died... 04:59:05.930608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Terminated: ok {rc=0} 04:59:05.974604 --- ParallelTerminationStrategy: PID 11333 died... 04:59:05.993494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Terminated: ok {rc=0} 04:59:06.037663 --- ParallelTerminationStrategy: PID 11336 died... 04:59:06.056474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11336): Terminated: ok {rc=0} 04:59:06.143945 bus /sierra_3: Setting Powered False 04:59:07.244002 bus /sierra_3: Setting Powered False 04:59:08.359864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2399 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 04:59:09.618608 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 04:59:09.623742 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 04:59:09.685520 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 04:59:09.711654 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 04:59:09.760935 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 04:59:09.823064 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 04:59:09.849209 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 04:59:10.400782 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2399 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 04:59:10.406000 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:10.416727 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:59:10.463369 tst handover.py: using LAC 38733 04:59:10.579814 tst handover.py: using RAC 228 04:59:10.696092 tst handover.py: using CellId 38733 04:59:10.826639 tst handover.py: using BVCI 38734 04:59:10.945638 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 04:59:10.995851 tst handover.py: using LAC 38734 04:59:11.121438 tst handover.py: using RAC 229 04:59:11.245507 tst handover.py: using CellId 38734 04:59:11.370237 tst handover.py: using BVCI 38735 04:59:11.488162 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:11.499540 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:11.510758 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:11.522113 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:11.533279 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 04:59:11.544210 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:11.661498 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 04:59:11.779231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 04:59:12.221662 run create_hlr_db(pid=11342): Launched 04:59:12.337677 bus /sierra_2: Setting Powered False 04:59:13.397471 run create_hlr_db(pid=11342): Terminated: ok {rc=0} 04:59:13.810980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11344): Launched 04:59:14.134706 run osmo-hlr_10.42.42.2(pid=11345): Launched 04:59:14.259060 run osmo-stp_10.42.42.5: Starting osmo-stp 04:59:14.788528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11347): Launched 04:59:15.111189 run osmo-stp_10.42.42.5(pid=11348): Launched 04:59:15.235402 run osmo-msc_10.42.42.6: Starting osmo-msc 04:59:15.793068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11350): Launched 04:59:16.163772 run osmo-msc_10.42.42.6(pid=11351): Launched 04:59:16.690789 run osmo-stp_10.42.42.5(pid=11348): ERR: Terminated: ERROR {rc=1} [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11348)] 04:59:16.956685 run osmo-stp_10.42.42.5(pid=11348): stdout: | (launched: 2022-12-14_04:59:15.052042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:17.114263 run osmo-stp_10.42.42.5(pid=11348): stderr: | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045915243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:17.245405 run osmo-stp_10.42.42.5(pid=11348): stdout: | (launched: 2022-12-14_04:59:15.052042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 04:59:17.370187 run osmo-stp_10.42.42.5(pid=11348): stderr: | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214045915242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214045915243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214045915243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 04:59:17.515535 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=11348): Process ended prematurely: osmo-stp_10.42.42.5(pid=11348) [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11348)] [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 04:59:17.523903 tst handover.py:18: Test FAILED (7.1 sec) 04:59:17.550075 run osmo-hlr_10.42.42.2(pid=11345): ERR: Terminated: ERROR {rc=237} [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11345)] 04:59:17.598733 run osmo-hlr_10.42.42.2(pid=11345): stdout: | (launched: 2022-12-14_04:59:14.075765) 04:59:17.648222 run osmo-hlr_10.42.42.2(pid=11345): stderr: | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214045914270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214045914283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214045914292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214045914293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214045914293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 04:59:17.717529 run osmo-msc_10.42.42.6(pid=11351): ERR: Terminated: ERROR {rc=2} [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11351)] 04:59:17.765093 run osmo-msc_10.42.42.6(pid=11351): stdout: | (launched: 2022-12-14_04:59:16.105867) 04:59:17.814196 run osmo-msc_10.42.42.6(pid=11351): stderr: | [0;m[38;5;43m20221214045916456 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214045916457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad994efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214045916458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214045916458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214045916458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214045916458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214045916460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214045916460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214045916460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214045916461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 04:59:17.863893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11344): Terminating (SIGTERM) 04:59:17.903767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11347): Terminating (SIGTERM) 04:59:17.943596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11350): Terminating (SIGTERM) 04:59:17.983605 --- ParallelTerminationStrategy: PID 11344 died... 04:59:18.002877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11344): Terminated: ok {rc=0} 04:59:18.047088 --- ParallelTerminationStrategy: PID 11347 died... 04:59:18.066115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11347): Terminated: ok {rc=0} 04:59:18.110375 --- ParallelTerminationStrategy: PID 11350 died... 04:59:18.129494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11350): Terminated: ok {rc=0} 04:59:18.216116 bus /sierra_3: Setting Powered False 04:59:19.315520 bus /sierra_3: Setting Powered False 04:59:20.430638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2399 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 04:59:21.702237 tst trial-2399: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399/run.2022-12-14_03-34-50/trial-2399.xml -------------------------------------------------------------------------------------------- trial-2399 FAIL -------------------------------------------------------------------------------------------- 04:59:23.625529 tst trial-2399: trial-2399: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=3450): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3450) [trial-2399↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3450)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=3461): Process ended prematurely: osmo-stp_10.42.42.5(pid=3461) [trial-2399↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3471) [trial-2399↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3471)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=3482): Process ended prematurely: osmo-stp_10.42.42.5(pid=3482) [trial-2399↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3482)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3496): Process ended prematurely: osmo-stp_10.42.42.5(pid=3496) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3496)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3507): Process ended prematurely: osmo-stp_10.42.42.5(pid=3507) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3507)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3521): Process ended prematurely: osmo-stp_10.42.42.5(pid=3521) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3521)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3532): Process ended prematurely: osmo-stp_10.42.42.5(pid=3532) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3532)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3549): Process ended prematurely: osmo-stp_10.42.42.5(pid=3549) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3549)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3560): Process ended prematurely: osmo-stp_10.42.42.5(pid=3560) [trial-2399↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3560)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3574): Process ended prematurely: osmo-stp_10.42.42.5(pid=3574) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3574)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3585): Process ended prematurely: osmo-stp_10.42.42.5(pid=3585) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3585)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=3871): Process ended prematurely: osmo-stp_10.42.42.5(pid=3871) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3871)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3882): Process ended prematurely: osmo-stp_10.42.42.5(pid=3882) [trial-2399↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3882)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3907): Process ended prematurely: osmo-stp_10.42.42.5(pid=3907) [trial-2399↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3907)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3921): Process ended prematurely: osmo-stp_10.42.42.5(pid=3921) [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3921)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3943): Process ended prematurely: osmo-stp_10.42.42.5(pid=3943) [trial-2399↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4308): Process ended prematurely: osmo-stp_10.42.42.5(pid=4308) [trial-2399↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4308)] FAIL: emergency_preemptive_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=4497): Process ended prematurely: osmo-stp_10.42.42.5(pid=4497) [trial-2399↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4497)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=4516): Process ended prematurely: osmo-stp_10.42.42.5(pid=4516) [trial-2399↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4516)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2399↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4547): Process ended prematurely: osmo-stp_10.42.42.5(pid=4547) [trial-2399↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4547)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4557): Process ended prematurely: osmo-stp_10.42.42.5(pid=4557) [trial-2399↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4557)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4567): Process ended prematurely: osmo-stp_10.42.42.5(pid=4567) [trial-2399↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4567)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4584): Process ended prematurely: osmo-stp_10.42.42.5(pid=4584) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4584)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4602): Process ended prematurely: osmo-stp_10.42.42.5(pid=4602) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4602)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=4620): Process ended prematurely: osmo-stp_10.42.42.5(pid=4620) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4620)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4630): Process ended prematurely: osmo-stp_10.42.42.5(pid=4630) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4630)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4640): Process ended prematurely: osmo-stp_10.42.42.5(pid=4640) [trial-2399↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4640)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=4657): Process ended prematurely: osmo-stp_10.42.42.5(pid=4657) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4657)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=4669): Process ended prematurely: osmo-stp_10.42.42.5(pid=4669) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4669)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4687): Process ended prematurely: osmo-stp_10.42.42.5(pid=4687) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4687)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4697): Process ended prematurely: osmo-stp_10.42.42.5(pid=4697) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4697)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2399↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=4725): Process ended prematurely: osmo-stp_10.42.42.5(pid=4725) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4725)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4737): Process ended prematurely: osmo-stp_10.42.42.5(pid=4737) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4755): Process ended prematurely: osmo-stp_10.42.42.5(pid=4755) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4755)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4765): Process ended prematurely: osmo-stp_10.42.42.5(pid=4765) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4765)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4775): Process ended prematurely: osmo-stp_10.42.42.5(pid=4775) [trial-2399↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4790): Process ended prematurely: osmo-stp_10.42.42.5(pid=4790) [trial-2399↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4790)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4804): Process ended prematurely: osmo-stp_10.42.42.5(pid=4804) [trial-2399↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4804)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=4815): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4815) [trial-2399↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4815)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4826): Process ended prematurely: osmo-stp_10.42.42.5(pid=4826) [trial-2399↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4826)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4835): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4835) [trial-2399↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4835)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4845): Process ended prematurely: osmo-stp_10.42.42.5(pid=4845) [trial-2399↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4845)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4860): Process ended prematurely: osmo-stp_10.42.42.5(pid=4860) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4860)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4872): Process ended prematurely: osmo-stp_10.42.42.5(pid=4872) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4872)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4886): Process ended prematurely: osmo-stp_10.42.42.5(pid=4886) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4886)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4897): Process ended prematurely: osmo-stp_10.42.42.5(pid=4897) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4897)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4911): Process ended prematurely: osmo-stp_10.42.42.5(pid=4911) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4911)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4922): Process ended prematurely: osmo-stp_10.42.42.5(pid=4922) [trial-2399↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4922)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4936): Process ended prematurely: osmo-stp_10.42.42.5(pid=4936) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4936)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4948): Process ended prematurely: osmo-stp_10.42.42.5(pid=4948) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4948)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4962): Process ended prematurely: osmo-stp_10.42.42.5(pid=4962) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4962)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4973): Process ended prematurely: osmo-stp_10.42.42.5(pid=4973) [trial-2399↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4973)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4988): Process ended prematurely: osmo-stp_10.42.42.5(pid=4988) [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4988)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4999): Process ended prematurely: osmo-stp_10.42.42.5(pid=4999) [trial-2399↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4999)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5013): Process ended prematurely: osmo-stp_10.42.42.5(pid=5013) [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5013)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5024): Process ended prematurely: osmo-stp_10.42.42.5(pid=5024) [trial-2399↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5024)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5038): Process ended prematurely: osmo-stp_10.42.42.5(pid=5038) [trial-2399↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5038)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5049): Process ended prematurely: osmo-stp_10.42.42.5(pid=5049) [trial-2399↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5049)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5067): Process ended prematurely: osmo-stp_10.42.42.5(pid=5067) [trial-2399↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5067)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5079): Process ended prematurely: osmo-stp_10.42.42.5(pid=5079) [trial-2399↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5079)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2399↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5107): Process ended prematurely: osmo-stp_10.42.42.5(pid=5107) [trial-2399↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5107)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5117): Process ended prematurely: osmo-stp_10.42.42.5(pid=5117) [trial-2399↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5117)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=5135): Process ended prematurely: osmo-stp_10.42.42.5(pid=5135) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5135)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=5147): Process ended prematurely: osmo-stp_10.42.42.5(pid=5147) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5147)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=5168): Process ended prematurely: osmo-stp_10.42.42.5(pid=5168) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5168)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5189): Process ended prematurely: osmo-stp_10.42.42.5(pid=5189) [trial-2399↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5189)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=5206): Process ended prematurely: osmo-stp_10.42.42.5(pid=5206) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5206)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=5222): Process ended prematurely: osmo-stp_10.42.42.5(pid=5222) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5222)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=5240): Process ended prematurely: osmo-stp_10.42.42.5(pid=5240) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5250): Process ended prematurely: osmo-stp_10.42.42.5(pid=5250) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5250)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5260): Process ended prematurely: osmo-stp_10.42.42.5(pid=5260) [trial-2399↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=5277): Process ended prematurely: osmo-stp_10.42.42.5(pid=5277) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5277)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=5289): Process ended prematurely: osmo-stp_10.42.42.5(pid=5289) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=5307): Process ended prematurely: osmo-stp_10.42.42.5(pid=5307) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5307)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5317): Process ended prematurely: osmo-stp_10.42.42.5(pid=5317) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5327): Process ended prematurely: osmo-stp_10.42.42.5(pid=5327) [trial-2399↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5327)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5340): Process ended prematurely: osmo-stp_10.42.42.5(pid=5340) [trial-2399↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5340)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5354): Process ended prematurely: osmo-stp_10.42.42.5(pid=5354) [trial-2399↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5354)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5364): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5364) [trial-2399↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5364)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=5374): Process ended prematurely: osmo-stp_10.42.42.5(pid=5374) [trial-2399↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5374)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=5383): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5383) [trial-2399↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5383)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=5393): Process ended prematurely: osmo-stp_10.42.42.5(pid=5393) [trial-2399↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5393)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5407): Process ended prematurely: osmo-stp_10.42.42.5(pid=5407) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5407)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5418): Process ended prematurely: osmo-stp_10.42.42.5(pid=5418) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5418)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5432): Process ended prematurely: osmo-stp_10.42.42.5(pid=5432) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5432)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5715): Process ended prematurely: osmo-stp_10.42.42.5(pid=5715) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5715)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5729): Process ended prematurely: osmo-stp_10.42.42.5(pid=5729) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5729)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5740): Process ended prematurely: osmo-stp_10.42.42.5(pid=5740) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5740)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5754): Process ended prematurely: osmo-stp_10.42.42.5(pid=5754) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5754)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5765): Process ended prematurely: osmo-stp_10.42.42.5(pid=5765) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5765)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5782): Process ended prematurely: osmo-stp_10.42.42.5(pid=5782) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5782)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5793): Process ended prematurely: osmo-stp_10.42.42.5(pid=5793) [trial-2399↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5793)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5808): Process ended prematurely: osmo-stp_10.42.42.5(pid=5808) [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5808)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5820): Process ended prematurely: osmo-stp_10.42.42.5(pid=5820) [trial-2399↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5820)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5835): Process ended prematurely: osmo-stp_10.42.42.5(pid=5835) [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5835)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5849): Process ended prematurely: osmo-stp_10.42.42.5(pid=5849) [trial-2399↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5849)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5863): Process ended prematurely: osmo-stp_10.42.42.5(pid=5863) [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5863)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5874): Process ended prematurely: osmo-stp_10.42.42.5(pid=5874) [trial-2399↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5874)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5888): Process ended prematurely: osmo-stp_10.42.42.5(pid=5888) [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5888)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5899): Process ended prematurely: osmo-stp_10.42.42.5(pid=5899) [trial-2399↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5899)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5913): Process ended prematurely: osmo-stp_10.42.42.5(pid=5913) [trial-2399↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5913)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5924): Process ended prematurely: osmo-stp_10.42.42.5(pid=5924) [trial-2399↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5924)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5942): Process ended prematurely: osmo-stp_10.42.42.5(pid=5942) [trial-2399↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=5955): Process ended prematurely: osmo-stp_10.42.42.5(pid=5955) [trial-2399↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5955)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=5973): Process ended prematurely: osmo-stp_10.42.42.5(pid=5973) [trial-2399↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5973)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5983): Process ended prematurely: osmo-stp_10.42.42.5(pid=5983) [trial-2399↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5983)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5993): Process ended prematurely: osmo-stp_10.42.42.5(pid=5993) [trial-2399↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5993)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6011): Process ended prematurely: osmo-stp_10.42.42.5(pid=6011) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6011)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=6023): Process ended prematurely: osmo-stp_10.42.42.5(pid=6023) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6023)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=6041): Process ended prematurely: osmo-stp_10.42.42.5(pid=6041) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6041)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=6052): Process ended prematurely: osmo-stp_10.42.42.5(pid=6052) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6052)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6062): Process ended prematurely: osmo-stp_10.42.42.5(pid=6062) [trial-2399↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6062)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=6079): Process ended prematurely: osmo-stp_10.42.42.5(pid=6079) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6079)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=6091): Process ended prematurely: osmo-stp_10.42.42.5(pid=6091) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6091)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=6110): Process ended prematurely: osmo-stp_10.42.42.5(pid=6110) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6110)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6123): Process ended prematurely: osmo-stp_10.42.42.5(pid=6123) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6123)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6133): Process ended prematurely: osmo-stp_10.42.42.5(pid=6133) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6133)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6150): Process ended prematurely: osmo-stp_10.42.42.5(pid=6150) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6150)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6163): Process ended prematurely: osmo-stp_10.42.42.5(pid=6163) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6163)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=6181): Process ended prematurely: osmo-stp_10.42.42.5(pid=6181) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6181)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6193): Process ended prematurely: osmo-stp_10.42.42.5(pid=6193) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6193)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6203): Process ended prematurely: osmo-stp_10.42.42.5(pid=6203) [trial-2399↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6203)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=6220): Process ended prematurely: osmo-stp_10.42.42.5(pid=6220) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6220)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=6232): Process ended prematurely: osmo-stp_10.42.42.5(pid=6232) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6232)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=6250): Process ended prematurely: osmo-stp_10.42.42.5(pid=6250) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6250)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6260): Process ended prematurely: osmo-stp_10.42.42.5(pid=6260) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6260)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6270): Process ended prematurely: osmo-stp_10.42.42.5(pid=6270) [trial-2399↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6270)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6284): Process ended prematurely: osmo-stp_10.42.42.5(pid=6284) [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6284)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6297): Process ended prematurely: osmo-stp_10.42.42.5(pid=6297) [trial-2399↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6297)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6305): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6305) [trial-2399↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6305)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=6315): Process ended prematurely: osmo-stp_10.42.42.5(pid=6315) [trial-2399↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6315)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6324): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6324) [trial-2399↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6324)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=6339): Process ended prematurely: osmo-stp_10.42.42.5(pid=6339) [trial-2399↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6339)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6353): Process ended prematurely: osmo-stp_10.42.42.5(pid=6353) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6353)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6364): Process ended prematurely: osmo-stp_10.42.42.5(pid=6364) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6364)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6379): Process ended prematurely: osmo-stp_10.42.42.5(pid=6379) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6379)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6390): Process ended prematurely: osmo-stp_10.42.42.5(pid=6390) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6390)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6415): Process ended prematurely: osmo-stp_10.42.42.5(pid=6415) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6415)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6429): Process ended prematurely: osmo-stp_10.42.42.5(pid=6429) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6429)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6440): Process ended prematurely: osmo-stp_10.42.42.5(pid=6440) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6440)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6454): Process ended prematurely: osmo-stp_10.42.42.5(pid=6454) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6454)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6465): Process ended prematurely: osmo-stp_10.42.42.5(pid=6465) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6465)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6482): Process ended prematurely: osmo-stp_10.42.42.5(pid=6482) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6493): Process ended prematurely: osmo-stp_10.42.42.5(pid=6493) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6493)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6507): Process ended prematurely: osmo-stp_10.42.42.5(pid=6507) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6518): Process ended prematurely: osmo-stp_10.42.42.5(pid=6518) [trial-2399↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6518)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6532): Process ended prematurely: osmo-stp_10.42.42.5(pid=6532) [trial-2399↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6543): Process ended prematurely: osmo-stp_10.42.42.5(pid=6543) [trial-2399↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6543)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=6562): Process ended prematurely: osmo-stp_10.42.42.5(pid=6562) [trial-2399↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6562)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=6574): Process ended prematurely: osmo-stp_10.42.42.5(pid=6574) [trial-2399↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6574)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=6592): Process ended prematurely: osmo-stp_10.42.42.5(pid=6592) [trial-2399↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6592)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6602): Process ended prematurely: osmo-stp_10.42.42.5(pid=6602) [trial-2399↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6602)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6612): Process ended prematurely: osmo-stp_10.42.42.5(pid=6612) [trial-2399↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6612)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=6629): Process ended prematurely: osmo-stp_10.42.42.5(pid=6629) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6629)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=6659): Process ended prematurely: osmo-stp_10.42.42.5(pid=6659) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6659)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6669): Process ended prematurely: osmo-stp_10.42.42.5(pid=6669) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6679): Process ended prematurely: osmo-stp_10.42.42.5(pid=6679) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6679)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=6696): Process ended prematurely: osmo-stp_10.42.42.5(pid=6696) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6696)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=6708): Process ended prematurely: osmo-stp_10.42.42.5(pid=6708) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6708)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=6726): Process ended prematurely: osmo-stp_10.42.42.5(pid=6726) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6726)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6736): Process ended prematurely: osmo-stp_10.42.42.5(pid=6736) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6736)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=7017): Process ended prematurely: osmo-stp_10.42.42.5(pid=7017) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7017)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=7036): Process ended prematurely: osmo-stp_10.42.42.5(pid=7036) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7036)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7049): Process ended prematurely: osmo-stp_10.42.42.5(pid=7049) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=7067): Process ended prematurely: osmo-stp_10.42.42.5(pid=7067) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7067)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7077): Process ended prematurely: osmo-stp_10.42.42.5(pid=7077) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7077)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7090): Process ended prematurely: osmo-stp_10.42.42.5(pid=7090) [trial-2399↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7104): Process ended prematurely: osmo-stp_10.42.42.5(pid=7104) [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7104)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7118): Process ended prematurely: osmo-stp_10.42.42.5(pid=7118) [trial-2399↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7118)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7126): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7126) [trial-2399↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7126)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7138): Process ended prematurely: osmo-stp_10.42.42.5(pid=7138) [trial-2399↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7138)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7150) [trial-2399↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7150)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7160): Process ended prematurely: osmo-stp_10.42.42.5(pid=7160) [trial-2399↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7160)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7174): Process ended prematurely: osmo-stp_10.42.42.5(pid=7174) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7174)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7185): Process ended prematurely: osmo-stp_10.42.42.5(pid=7185) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7185)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7199): Process ended prematurely: osmo-stp_10.42.42.5(pid=7199) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7199)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7210): Process ended prematurely: osmo-stp_10.42.42.5(pid=7210) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7210)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7224): Process ended prematurely: osmo-stp_10.42.42.5(pid=7224) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7224)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7235): Process ended prematurely: osmo-stp_10.42.42.5(pid=7235) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7235)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7249): Process ended prematurely: osmo-stp_10.42.42.5(pid=7249) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7249)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7260): Process ended prematurely: osmo-stp_10.42.42.5(pid=7260) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7260)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7274): Process ended prematurely: osmo-stp_10.42.42.5(pid=7274) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7274)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7285): Process ended prematurely: osmo-stp_10.42.42.5(pid=7285) [trial-2399↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7285)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7299): Process ended prematurely: osmo-stp_10.42.42.5(pid=7299) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7299)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7310): Process ended prematurely: osmo-stp_10.42.42.5(pid=7310) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7310)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7324): Process ended prematurely: osmo-stp_10.42.42.5(pid=7324) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7324)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7335): Process ended prematurely: osmo-stp_10.42.42.5(pid=7335) [trial-2399↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7335)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7350): Process ended prematurely: osmo-stp_10.42.42.5(pid=7350) [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7350)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7361): Process ended prematurely: osmo-stp_10.42.42.5(pid=7361) [trial-2399↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7361)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7375): Process ended prematurely: osmo-stp_10.42.42.5(pid=7375) [trial-2399↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7375)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7386): Process ended prematurely: osmo-stp_10.42.42.5(pid=7386) [trial-2399↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7386)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7404): Process ended prematurely: osmo-stp_10.42.42.5(pid=7404) [trial-2399↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7404)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7416): Process ended prematurely: osmo-stp_10.42.42.5(pid=7416) [trial-2399↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7416)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=7435): Process ended prematurely: osmo-stp_10.42.42.5(pid=7435) [trial-2399↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7435)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2399↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7458): Process ended prematurely: osmo-stp_10.42.42.5(pid=7458) [trial-2399↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7458)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7475): Process ended prematurely: osmo-stp_10.42.42.5(pid=7475) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7475)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7487): Process ended prematurely: osmo-stp_10.42.42.5(pid=7487) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7506): Process ended prematurely: osmo-stp_10.42.42.5(pid=7506) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7506)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7516): Process ended prematurely: osmo-stp_10.42.42.5(pid=7516) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7516)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7526): Process ended prematurely: osmo-stp_10.42.42.5(pid=7526) [trial-2399↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7526)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7543): Process ended prematurely: osmo-stp_10.42.42.5(pid=7543) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7543)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7555): Process ended prematurely: osmo-stp_10.42.42.5(pid=7555) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7555)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7573): Process ended prematurely: osmo-stp_10.42.42.5(pid=7573) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7573)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7586): Process ended prematurely: osmo-stp_10.42.42.5(pid=7586) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7586)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7596): Process ended prematurely: osmo-stp_10.42.42.5(pid=7596) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7596)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7614): Process ended prematurely: osmo-stp_10.42.42.5(pid=7614) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7614)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7626): Process ended prematurely: osmo-stp_10.42.42.5(pid=7626) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=7644): Process ended prematurely: osmo-stp_10.42.42.5(pid=7644) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7644)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7654): Process ended prematurely: osmo-stp_10.42.42.5(pid=7654) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7654)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7664): Process ended prematurely: osmo-stp_10.42.42.5(pid=7664) [trial-2399↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7664)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7681): Process ended prematurely: osmo-stp_10.42.42.5(pid=7681) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7681)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=7693): Process ended prematurely: osmo-stp_10.42.42.5(pid=7693) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7693)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7711): Process ended prematurely: osmo-stp_10.42.42.5(pid=7711) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7711)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7722): Process ended prematurely: osmo-stp_10.42.42.5(pid=7722) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7722)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7732): Process ended prematurely: osmo-stp_10.42.42.5(pid=7732) [trial-2399↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7732)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7745): Process ended prematurely: osmo-stp_10.42.42.5(pid=7745) [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7745)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7759): Process ended prematurely: osmo-stp_10.42.42.5(pid=7759) [trial-2399↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7759)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7767): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7767) [trial-2399↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7767)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2399↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7790) [trial-2399↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7790)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7800): Process ended prematurely: osmo-stp_10.42.42.5(pid=7800) [trial-2399↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7800)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7814): Process ended prematurely: osmo-stp_10.42.42.5(pid=7814) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7814)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7825): Process ended prematurely: osmo-stp_10.42.42.5(pid=7825) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7825)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7839): Process ended prematurely: osmo-stp_10.42.42.5(pid=7839) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7839)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7852): Process ended prematurely: osmo-stp_10.42.42.5(pid=7852) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7852)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7866): Process ended prematurely: osmo-stp_10.42.42.5(pid=7866) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7866)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7877): Process ended prematurely: osmo-stp_10.42.42.5(pid=7877) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7877)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7891): Process ended prematurely: osmo-stp_10.42.42.5(pid=7891) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7891)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7902): Process ended prematurely: osmo-stp_10.42.42.5(pid=7902) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7902)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7916): Process ended prematurely: osmo-stp_10.42.42.5(pid=7916) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7916)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7927): Process ended prematurely: osmo-stp_10.42.42.5(pid=7927) [trial-2399↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7927)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7941): Process ended prematurely: osmo-stp_10.42.42.5(pid=7941) [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7952): Process ended prematurely: osmo-stp_10.42.42.5(pid=7952) [trial-2399↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7952)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7966): Process ended prematurely: osmo-stp_10.42.42.5(pid=7966) [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7966)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7977): Process ended prematurely: osmo-stp_10.42.42.5(pid=7977) [trial-2399↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7977)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7992): Process ended prematurely: osmo-stp_10.42.42.5(pid=7992) [trial-2399↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7992)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8003): Process ended prematurely: osmo-stp_10.42.42.5(pid=8003) [trial-2399↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8003)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8021): Process ended prematurely: osmo-stp_10.42.42.5(pid=8021) [trial-2399↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8021)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8033): Process ended prematurely: osmo-stp_10.42.42.5(pid=8033) [trial-2399↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8033)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8051): Process ended prematurely: osmo-stp_10.42.42.5(pid=8051) [trial-2399↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8051)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8062): Process ended prematurely: osmo-stp_10.42.42.5(pid=8062) [trial-2399↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8062)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8343): Process ended prematurely: osmo-stp_10.42.42.5(pid=8343) [trial-2399↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8343)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=8362): Process ended prematurely: osmo-stp_10.42.42.5(pid=8362) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8362)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8374): Process ended prematurely: osmo-stp_10.42.42.5(pid=8374) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8374)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=8392): Process ended prematurely: osmo-stp_10.42.42.5(pid=8392) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8392)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8405): Process ended prematurely: osmo-stp_10.42.42.5(pid=8405) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8405)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8416): Process ended prematurely: osmo-stp_10.42.42.5(pid=8416) [trial-2399↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8416)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8433): Process ended prematurely: osmo-stp_10.42.42.5(pid=8433) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8433)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8445): Process ended prematurely: osmo-stp_10.42.42.5(pid=8445) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8445)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8463): Process ended prematurely: osmo-stp_10.42.42.5(pid=8463) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8463)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8474): Process ended prematurely: osmo-stp_10.42.42.5(pid=8474) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8474)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8484): Process ended prematurely: osmo-stp_10.42.42.5(pid=8484) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8484)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8501): Process ended prematurely: osmo-stp_10.42.42.5(pid=8501) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8501)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8513): Process ended prematurely: osmo-stp_10.42.42.5(pid=8513) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8513)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8531): Process ended prematurely: osmo-stp_10.42.42.5(pid=8531) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8531)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8541): Process ended prematurely: osmo-stp_10.42.42.5(pid=8541) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8541)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8552): Process ended prematurely: osmo-stp_10.42.42.5(pid=8552) [trial-2399↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8566): Process ended prematurely: osmo-stp_10.42.42.5(pid=8566) [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8566)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8580): Process ended prematurely: osmo-stp_10.42.42.5(pid=8580) [trial-2399↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8580)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8588): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8588) [trial-2399↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8588)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8598): Process ended prematurely: osmo-stp_10.42.42.5(pid=8598) [trial-2399↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8598)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8607) [trial-2399↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8607)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=8618): Process ended prematurely: osmo-stp_10.42.42.5(pid=8618) [trial-2399↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8618)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8632): Process ended prematurely: osmo-stp_10.42.42.5(pid=8632) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8632)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8657): Process ended prematurely: osmo-stp_10.42.42.5(pid=8657) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8657)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8668): Process ended prematurely: osmo-stp_10.42.42.5(pid=8668) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8668)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8682): Process ended prematurely: osmo-stp_10.42.42.5(pid=8682) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8682)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8693): Process ended prematurely: osmo-stp_10.42.42.5(pid=8693) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8693)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8707): Process ended prematurely: osmo-stp_10.42.42.5(pid=8707) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8707)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8718): Process ended prematurely: osmo-stp_10.42.42.5(pid=8718) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8718)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8732): Process ended prematurely: osmo-stp_10.42.42.5(pid=8732) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8732)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8743): Process ended prematurely: osmo-stp_10.42.42.5(pid=8743) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8743)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8760): Process ended prematurely: osmo-stp_10.42.42.5(pid=8760) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8771): Process ended prematurely: osmo-stp_10.42.42.5(pid=8771) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8771)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8786): Process ended prematurely: osmo-stp_10.42.42.5(pid=8786) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8797): Process ended prematurely: osmo-stp_10.42.42.5(pid=8797) [trial-2399↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8797)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8812): Process ended prematurely: osmo-stp_10.42.42.5(pid=8812) [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8812)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8823): Process ended prematurely: osmo-stp_10.42.42.5(pid=8823) [trial-2399↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8823)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8841): Process ended prematurely: osmo-stp_10.42.42.5(pid=8841) [trial-2399↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8841)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8871): Process ended prematurely: osmo-stp_10.42.42.5(pid=8871) [trial-2399↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8871)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8881): Process ended prematurely: osmo-stp_10.42.42.5(pid=8881) [trial-2399↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2399↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8908): Process ended prematurely: osmo-stp_10.42.42.5(pid=8908) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8908)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=8920): Process ended prematurely: osmo-stp_10.42.42.5(pid=8920) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8920)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8938): Process ended prematurely: osmo-stp_10.42.42.5(pid=8938) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8938)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8948): Process ended prematurely: osmo-stp_10.42.42.5(pid=8948) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8948)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8959): Process ended prematurely: osmo-stp_10.42.42.5(pid=8959) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8977): Process ended prematurely: osmo-stp_10.42.42.5(pid=8977) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8977)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8989): Process ended prematurely: osmo-stp_10.42.42.5(pid=8989) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8989)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=9008): Process ended prematurely: osmo-stp_10.42.42.5(pid=9008) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9008)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9018): Process ended prematurely: osmo-stp_10.42.42.5(pid=9018) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9018)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9028): Process ended prematurely: osmo-stp_10.42.42.5(pid=9028) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9028)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9046): Process ended prematurely: osmo-stp_10.42.42.5(pid=9046) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9046)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9058): Process ended prematurely: osmo-stp_10.42.42.5(pid=9058) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9076): Process ended prematurely: osmo-stp_10.42.42.5(pid=9076) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9076)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9086): Process ended prematurely: osmo-stp_10.42.42.5(pid=9086) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9086)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9099): Process ended prematurely: osmo-stp_10.42.42.5(pid=9099) [trial-2399↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9113): Process ended prematurely: osmo-stp_10.42.42.5(pid=9113) [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9126): Process ended prematurely: osmo-stp_10.42.42.5(pid=9126) [trial-2399↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9126)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9135): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9135) [trial-2399↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9135)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9145): Process ended prematurely: osmo-stp_10.42.42.5(pid=9145) [trial-2399↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9154): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9154) [trial-2399↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9154)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=9168): Process ended prematurely: osmo-stp_10.42.42.5(pid=9168) [trial-2399↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9168)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9182): Process ended prematurely: osmo-stp_10.42.42.5(pid=9182) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9193): Process ended prematurely: osmo-stp_10.42.42.5(pid=9193) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9193)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9207): Process ended prematurely: osmo-stp_10.42.42.5(pid=9207) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9207)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9232): Process ended prematurely: osmo-stp_10.42.42.5(pid=9232) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9243): Process ended prematurely: osmo-stp_10.42.42.5(pid=9243) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9243)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9257): Process ended prematurely: osmo-stp_10.42.42.5(pid=9257) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9257)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9268): Process ended prematurely: osmo-stp_10.42.42.5(pid=9268) [trial-2399↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9268)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9282): Process ended prematurely: osmo-stp_10.42.42.5(pid=9282) [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9293): Process ended prematurely: osmo-stp_10.42.42.5(pid=9293) [trial-2399↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9293)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2399↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2399↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=9337): Process ended prematurely: osmo-stp_10.42.42.5(pid=9337) [trial-2399↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9337)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9349): Process ended prematurely: osmo-stp_10.42.42.5(pid=9349) [trial-2399↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9349)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9367): Process ended prematurely: osmo-stp_10.42.42.5(pid=9367) [trial-2399↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9367)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9540): Process ended prematurely: osmo-stp_10.42.42.5(pid=9540) [trial-2399↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9540)] FAIL: ping_idle_ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=9658): Process ended prematurely: osmo-stp_10.42.42.5(pid=9658) [trial-2399↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9658)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=9676): Process ended prematurely: osmo-stp_10.42.42.5(pid=9676) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9676)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9690): Process ended prematurely: osmo-stp_10.42.42.5(pid=9690) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9690)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9708): Process ended prematurely: osmo-stp_10.42.42.5(pid=9708) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9708)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9721): Process ended prematurely: osmo-stp_10.42.42.5(pid=9721) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9721)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9731): Process ended prematurely: osmo-stp_10.42.42.5(pid=9731) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9731)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=9748): Process ended prematurely: osmo-stp_10.42.42.5(pid=9748) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9748)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=9778): Process ended prematurely: osmo-stp_10.42.42.5(pid=9778) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9778)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9801): Process ended prematurely: osmo-stp_10.42.42.5(pid=9801) [trial-2399↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9801)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9814): Process ended prematurely: osmo-stp_10.42.42.5(pid=9814) [trial-2399↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9814)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9827): Process ended prematurely: osmo-stp_10.42.42.5(pid=9827) [trial-2399↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9827)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9836): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9836) [trial-2399↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9836)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9846): Process ended prematurely: osmo-stp_10.42.42.5(pid=9846) [trial-2399↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9846)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9860): Process ended prematurely: osmo-stp_10.42.42.5(pid=9860) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9860)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9875): Process ended prematurely: osmo-stp_10.42.42.5(pid=9875) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9889): Process ended prematurely: osmo-stp_10.42.42.5(pid=9889) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9900): Process ended prematurely: osmo-stp_10.42.42.5(pid=9900) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9914): Process ended prematurely: osmo-stp_10.42.42.5(pid=9914) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9925): Process ended prematurely: osmo-stp_10.42.42.5(pid=9925) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9939): Process ended prematurely: osmo-stp_10.42.42.5(pid=9939) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2399↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9965): Process ended prematurely: osmo-stp_10.42.42.5(pid=9965) [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9965)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9976): Process ended prematurely: osmo-stp_10.42.42.5(pid=9976) [trial-2399↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9990): Process ended prematurely: osmo-stp_10.42.42.5(pid=9990) [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9990)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2399↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10015): Process ended prematurely: osmo-stp_10.42.42.5(pid=10015) [trial-2399↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10015)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2399↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10045): Process ended prematurely: osmo-stp_10.42.42.5(pid=10045) [trial-2399↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10045)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10057): Process ended prematurely: osmo-stp_10.42.42.5(pid=10057) [trial-2399↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10057)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10075): Process ended prematurely: osmo-stp_10.42.42.5(pid=10075) [trial-2399↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10075)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2399↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10098): Process ended prematurely: osmo-stp_10.42.42.5(pid=10098) [trial-2399↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10098)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10115): Process ended prematurely: osmo-stp_10.42.42.5(pid=10115) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10115)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10147): Process ended prematurely: osmo-stp_10.42.42.5(pid=10147) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10147)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10157): Process ended prematurely: osmo-stp_10.42.42.5(pid=10157) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10167): Process ended prematurely: osmo-stp_10.42.42.5(pid=10167) [trial-2399↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10184): Process ended prematurely: osmo-stp_10.42.42.5(pid=10184) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10184)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2399↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10254): Process ended prematurely: osmo-stp_10.42.42.5(pid=10254) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10254)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10266): Process ended prematurely: osmo-stp_10.42.42.5(pid=10266) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=10284): Process ended prematurely: osmo-stp_10.42.42.5(pid=10284) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10284)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10294): Process ended prematurely: osmo-stp_10.42.42.5(pid=10294) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10294)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10304): Process ended prematurely: osmo-stp_10.42.42.5(pid=10304) [trial-2399↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10319): Process ended prematurely: osmo-stp_10.42.42.5(pid=10319) [trial-2399↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10319)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=10327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10327) [trial-2399↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10327)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=10329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10329) [trial-2399↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10329)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=10331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10331) [trial-2399↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10331)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10333) [trial-2399↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10333)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=10342): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10342) [trial-2399↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10342)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=10353): Process ended prematurely: osmo-hlr_10.42.42.2(pid=10353) [trial-2399↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10353)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2399↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10376): Process ended prematurely: osmo-stp_10.42.42.5(pid=10376) [trial-2399↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10376)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10391): Process ended prematurely: osmo-stp_10.42.42.5(pid=10391) [trial-2399↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10391)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10402): Process ended prematurely: osmo-stp_10.42.42.5(pid=10402) [trial-2399↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10402)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10413): Process ended prematurely: osmo-stp_10.42.42.5(pid=10413) [trial-2399↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10413)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2399↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=10449): Process ended prematurely: srsepc(pid=10449) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10449)] FAIL: iperf3_bidir.py (18.7 sec) Error: srsepc(pid=10465): Process ended prematurely: srsepc(pid=10465) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10465)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=10483): Process ended prematurely: srsepc(pid=10483) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10483)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=10499): Process ended prematurely: srsepc(pid=10499) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10499)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=10515): Process ended prematurely: srsepc(pid=10515) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10515)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=10531): Process ended prematurely: srsepc(pid=10531) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10531)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=10547): Process ended prematurely: srsepc(pid=10547) [trial-2399↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=10547)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2399↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10577): Process ended prematurely: osmo-stp_10.42.42.5(pid=10577) [trial-2399↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10577)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10591): Process ended prematurely: osmo-stp_10.42.42.5(pid=10591) [trial-2399↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10591)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10605): Process ended prematurely: osmo-stp_10.42.42.5(pid=10605) [trial-2399↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10605)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=10619): Process ended prematurely: osmo-stp_10.42.42.5(pid=10619) [trial-2399↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10619)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10633): Process ended prematurely: osmo-stp_10.42.42.5(pid=10633) [trial-2399↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10633)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10647): Process ended prematurely: osmo-stp_10.42.42.5(pid=10647) [trial-2399↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10661): Process ended prematurely: osmo-stp_10.42.42.5(pid=10661) [trial-2399↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10661)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10675): Process ended prematurely: osmo-stp_10.42.42.5(pid=10675) [trial-2399↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10675)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10974): Process ended prematurely: osmo-stp_10.42.42.5(pid=10974) [trial-2399↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10974)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2399↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11004): Process ended prematurely: osmo-stp_10.42.42.5(pid=11004) [trial-2399↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11004)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11019): Process ended prematurely: osmo-stp_10.42.42.5(pid=11019) [trial-2399↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11019)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11033): Process ended prematurely: osmo-stp_10.42.42.5(pid=11033) [trial-2399↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11033)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11050): Process ended prematurely: osmo-stp_10.42.42.5(pid=11050) [trial-2399↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11050)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11064): Process ended prematurely: osmo-stp_10.42.42.5(pid=11064) [trial-2399↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11064)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11078): Process ended prematurely: osmo-stp_10.42.42.5(pid=11078) [trial-2399↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11092): Process ended prematurely: osmo-stp_10.42.42.5(pid=11092) [trial-2399↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11108): Process ended prematurely: osmo-stp_10.42.42.5(pid=11108) [trial-2399↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11122): Process ended prematurely: osmo-stp_10.42.42.5(pid=11122) [trial-2399↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11122)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11136): Process ended prematurely: osmo-stp_10.42.42.5(pid=11136) [trial-2399↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11136)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11150): Process ended prematurely: osmo-stp_10.42.42.5(pid=11150) [trial-2399↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11164): Process ended prematurely: osmo-stp_10.42.42.5(pid=11164) [trial-2399↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11164)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11178): Process ended prematurely: osmo-stp_10.42.42.5(pid=11178) [trial-2399↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11192): Process ended prematurely: osmo-stp_10.42.42.5(pid=11192) [trial-2399↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11206): Process ended prematurely: osmo-stp_10.42.42.5(pid=11206) [trial-2399↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11206)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11222): Process ended prematurely: osmo-stp_10.42.42.5(pid=11222) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11222)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11236): Process ended prematurely: osmo-stp_10.42.42.5(pid=11236) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11236)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11264): Process ended prematurely: osmo-stp_10.42.42.5(pid=11264) [trial-2399↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11264)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11278): Process ended prematurely: osmo-stp_10.42.42.5(pid=11278) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11278)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11292): Process ended prematurely: osmo-stp_10.42.42.5(pid=11292) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11306): Process ended prematurely: osmo-stp_10.42.42.5(pid=11306) [trial-2399↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11306)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11320): Process ended prematurely: osmo-stp_10.42.42.5(pid=11320) [trial-2399↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11320)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11334): Process ended prematurely: osmo-stp_10.42.42.5(pid=11334) [trial-2399↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=11348): Process ended prematurely: osmo-stp_10.42.42.5(pid=11348) [trial-2399↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11348)] + rm -rf trial-2399/inst + cd trial-2399 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 03:34:38 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399-run.tgz run.2022-12-14_03-34-50 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2399-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2994.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE